I love how you can hear the fan going with the gaussian splatter

NeRF and gaussian splatting are so realistic that they even captured the wind.

Not exaggerating, when Gaussian Splatting became to sudden prominence, I was waiting for a video exactly like this.

For anyone interested, here's my TLDR of the video: Biggest advantage of photogrammetry method (polygonal): model is metrically valid, can be used for measurements, model is fairly lightweight as it's a model, polygonal, and also less computationally taxing to post-process for the same reason, can use in many software aand share easily. Advantage of NeRFs (radiance field): includes more scene information (distance, sky), but this info is estimated, generated (via color info aka a radiance field) in realtime so perhaps it's not the most scientifically accurate. But because a full scene is being computed, creating new "footage" from novel viewpoints is possible. Advantage of Guassian Splat (static point cloud): includes scene information like NeRFs, but is not being computed in realtime aka it's a static point cloud (or splat cloud). Because the visualization is static, Guassian Splats can be used in many visualization software (game engines like Unity, Unreal, as well as 3D software like Blender, Cinema 4D). It's "the best of both worlds". Also, of course, it's the most fun to say :)

I have never used either of these techniques, however ever since I've seen these technologies become popular, i had a really poor understanding and had no idea how they compared, but still remained curious. This video filled the gap in my understanding perfectly

Hi, great video - I think it clarifies to a lot of people the difference between the three different technologies. Just one thing that would have been important to mention, is the biggest advantages of NERF and GS is the ability to capture reflections, and even transparency, which is just about impossible with Photogrammetrie. Granted that your example is, of course, not the right one to demonstrate these features but maybe you have a different set of images where you can demonstrate that difference in more detail.

This was exactly what i was looking for! I tried gaussian in unity in vr. I have to try with your conclusion. Thanks!!! Subscribed! :)

Thanks for making this video! I've been playing with photogrammetry for about 6 - 7 years, and have only been a curious bystander with respect to neRF and GS. It's interesting but I envisioned something like neRF and GS in conjunction with 3D meshes several years ago, before learning that they exist. Your video does a wonderful job of explaining the distinction between the three, especially between neRF and GS. I watched til the end! Thank you for creating it. I'll connect with you on your social accounts and hopefully we'll run into each other in the unfolding "metaverse".

Thanks a lot! That was exactly the quick introduction to the subject that I needed!

Very cool work thanks!

Thank you!! I’ve been looking for a video like this since I learnt about Gaussian splatting. Also the music you played in the showcases was chilling :))

Thanks for the good comparison video! You did a great job highlighting many of the topics of interest! 👏👏👏

Amazing comparison! And very cool flying scenes for NeRF and Gaussian Splats.

thanks this was super helpful

The splatter is really cool looking. Looks like a hallucination or a dream

I have absolutely no affiliation with anything 3D-related though somehow I find this Gaussian Splatting thing so intriguing though I had no clear understanding what it was haha. Just that you could make high quality looking 3D renders of things with just a video. Cool to actually see a more technical and comparison video about it. Thank you for making this video!

Could be cool to use an example with more variance in material properties, to showcase how different techniques deal with things like reflectivity and transparency.

Thanks for the video! The best way to learn the difference about NeRF and gaussian splatting 🙏🏻

thank you very much for this video :D superb for future developments in archaeology. I am already checking NERF with Kiri Engine, but I loved to see how to do it with the tools you mentioned. Coool!

Very valuable information for us 3D creators. Thank you very much!

Thank you, it was very educational and enjoyable video!

Great comparision of different methods! Looking at the drone video vs the output, it seems clear that all these technologies will get better when we get more processing power. The current output is nowhere close the detail level of input video but there's no reason to think it couldn't be given enough computing resources.

Wonderful work, really appreciate it

superb explanation...thank you for sharing your knowledge.

The last shot is really good!

This is absolutely amazing! I think Gaussian Splatting might replace rasterised/polygonal rendering in the near future!

Ooh thanks for this overview. Very helpful.

Thank you for explaining brother! 💪

That's an amazingly beautiful rock formation, not that it's the topic of the video but just felt like mentioning it

Very intriguing comparison. Had not heard of Gaussian Splatting previously. With Photogrammetry it would be possible to model different sun angle and lighting effects. Could be interesting to explore how the various could take advantage of video captures taken at different times of day. For example, could allow for animating time and motion. Just a thought that might be interesting to explore.

honestly I love the gaussian splatting look. Especially when you move "too" close :D

Good comparison and review. Good notes, links in the video info grey area.

I think photogrametry and some kind of Gaussian splatting will be fused one day

Great comparison! Could you have cropped the splats that were interrupting the sky in your Unity example for a cleaner look - or is that limited?

you can also compare nvidia's neuralangelo. that would be great

I love the examples, and the discussion on the technical differences. Though could definitely use better quality screen capture.

Well described ❤ Appreciate ❤

Great work! Keep doing the stuff! Like and subcribed!

Great job, subbed. 🎉

interesting , good informative vid , thankyou, as a side note, lets consider Bob ross once painted 50 sheds and 1 tree.

Great video, I think if you reuploaded this with better quality it could gather even more attention.

Cool. Thanks for sharing.

intersting fact is that nerf technically uses ml to search for the camera positions. the process stops when the render of the estimated volume matches the photo itself. ( within a threshold )

Hey matthew, thank you very much for making this video comparison. I have been wondering about Gaussian Splating all week long. But still I fail to see how is this a 3D rendering revolution like many in the community are saying, I don't understand the hype. Which could be the applications for this? Is it possible to make meshes from this point clouds? Can we make it collide with other objects in a scene? Can it be re lighten? To me it feels like baked lighting textures without a body. Please take me out of my miserable ignorance, what are the possible/theoretical applications?

It seems that the next step is a neural/AI enhanced version of guassian splatting to improve quality/render performance/data size.

Oh hey I've been there. Recognized it before you even said "Church Rock". Nice stretch of road just outside Canyonlands National jawdropping park.

Thx for the vids - deep respect for your knowledge and sharing it. (needed to watch it in 1.5x tho - otherwise it would have been kind of as if told in slow motion xD)

very very interesting

Nobody gonna talk about how the rock looks like a space ship that turned into stone?

Thanks for the good video and for providing the nice dataset. What is the focal length of your drone's camera (full frame equivalent)?

Seeing Matthew's analysis of these three technologies was quite insightful. It brought to mind a question an architect friend once posed: Could one feasibly craft an architectural blueprint of a home or apartment using video footage? Considering your experience with these three tech contenders, would you say we're on the brink of making this potential a reality?

Big up my friend!

Thanks - I'd like to see a comparison of how you would actually use these in production - especially NERF and splatting.

Hi Matthew! Thanks for this video. I'm new and a total noob to this field. I'm a Marketer and my line of work I'm having to learn a lot of these things including reality capture, photogrammetry, NeRFs, 3D GS, Digital Twin. Do you have videos that are educational about these aspects which would help a beginner like me to understand the basics?

Very well done. You mentioned using data resulting from aligning photos in Metashape in place of ColeMap for NeRF studio. Can this substitution of processing also be done for Gaussian Splatting? I'd love to use the aligned photo data & camera model data from many Metashape (standard edition) projects for GS without using ColeMap as Im already confident in the alignment. Any suggestions on how to accomplish that?

Is this purpose-driven for a particular field? I've always been fond of the intersection between geospatial tech and the broader CS/gaming world.

Hi Matthew. Great video explanation. Which drone did you use for this test? Do you have by any chance any more drone footage? Have you use the DJI Mavick 3 pro Cine for photogrammetry? Thanks.

Hi Matt, are you testing with NV Omniverse? Great video!

Cool stuff! I was thinking regarding the fact that extracting images from a movie gives poor photos: is there a way to extract higher quality images that you're aware of? I'm thinking it would be fairly straight forward to create an ai that takes five images in a row and creates a de-blurred version of the middle image using data from all five images. Or are there additional issues?

What do you thing is currently the best technology to scan faces to create highly accurate 3d files? Which are also future proof in terms of working with them? The priority is accuracy and feasibility for a non-professional. If we are limiting to cost to maybe 5 to 10 grand? Photogrammetry, a 3D scanner like from Einscan, NeRF or anything else? Do you know of any software that could benefit from having more than 1 camera at a time for photogrammetry? When I look at professional studios, they have like a hundred cameras surrounding a person that gets scanned.

This is nuts for set design, remodels... Be interesting to see what could be done with scopes for plumbers, both doctors and the ones with the butt crackin.

hey :) question regarding the 3Dmodel in the sphere. did u shoot the panorama exactly on top and center of the poi (the rock)? and is there a tutorial how to do the hole 3D process in blender? thx, kind regards sebastian

Where is the panorama sphere texture coming from that you used in the end?

which would work best for a house with trees all around? and is there a way to see past the trees in any way? or would i need to fly my drone down into and past the tree line?

Great video, thank you. Could you advise me how to scan an object very sharply for gaussian splatting? As it happens, I can't get it sharp. The letters are not clear. I own an android (s22 samsung, nikon z50, insta 360 x3). Which one would be the most accurate? As I am using the texture for training purpose. Thanks in advance. Greetings, Sebas

Interesting how the NeRF has captured the changing cloud shadow over time as a positional aspect

Working with photogrametry for 15 years or more to. And i tested Nerf as soon as they got out, and all nice and cool untill you give them uniform reflective surfaces. Photogrametry and Nerfs do not like uniform glossy surfaces. GS have no problm, they even get transparency,. Is an insane technology, far from perfect, have very limited use case, but i can see already GS being perfect solution for then next generation of realistic 3D google maps. Are very small and a lot easyer to do then NerFs and can be used with night shots to.

what is the name of the music used at 14:30?

I'd say, if your using reflective or translucent surfaces,i 100% recommend nerfs instead of photogrammatry, cuz it does it somuch better

It's me or from 8:30 and a half the quality of video seems 480? I can appreciate the quality correctly because seems a 480p video rescalated. Aside of that the video is very interesting.

Hello Matthew, thank you very much for your response. I assume I need to create an mp4 file if I want to scan a gaussian splatter. What are the settings? I am really a novice in this. Previously I was doing an fps 30. Is it convenient to set fps60? Thanks in advance.

great video. except that the definition is not good even in 2160, it appeared blurry ?

Pity about the low resolution. I assume it's low resolution as that's how it appears on my computer, even at 4K. Very interesting though!

Hi, you said we can export camera positions from 1st method and import it into NeRF to reduce amount of work for neural network and speed up a process. Don't you know how to do this with MeshRoom and colmap (or instant ngp)? Recently I was trying to make a NeRF with those tools but found that even after 2 days of work it was still processing the data (which are around 1200 frames from video).

How exactly do I make the sphere itself ? Can you make a step by step please. I do lots of photogrammetry models but I laways fail to add some background

That's a rock

Nice comparison! And finally, someone pronounces "Gaussian" correctly. Tired of these other youtube "gawzhin splatting" experts.

Matthew, may i know what is your computer specification when creating this?

It should be no problem to import the photogrammetry model into blender, import a world texture (photosphere) and render a similar camera path.

I wish the source videos were higher quality... Especially the Nerf part is painful to watch

What dhrone and camera you used? :)

Good video, but I have some tips. 1: Get a capture card so your system usage doesn't effect quality, it's hard to tell which method is better when the resource intensive ones are in 240p. And 2: either write a script or, if you want to maintain your natural manner of speaking, do a dry run first. Go though all your talking points once, then immediately start recording and do it again. Should help you move along a little faster and keep your pauses and "ums" to a minimum.

Why the video is blurred at 1440p?

Could you release the generated models in this video? I’m interested to run my own model for comparisons

Imaging google earth with gaussian splatting.

I don't know what is the third method more than I did before starting your video

Ok. Why did the psychedelic sky of the gaussian splat give me a panic attack? I'm going to call it a Splat Attack.

It would be nice if in a few years the Gaussian splatting has a way to erase things you don't want, or correct blurry parts of a scene. Gaussian to mesh would be the holy grail.

Hello, Brennnan, May I ask you how long did the Gaussian Splatting method reconstruction takes you to get that church rock? I used a RTX 3080 machine and it will take me about 24 hours to reconstruct it(I start reconstruction last night, and it is still running now finished 45%). I dont know if it is OK......

you can make a camera path around photogrammetry just as easily though, no?

The capture of the SW is really blurry 😞

does anybody know if nerf or gaussian spalatting work with 360 images?

19:32 Music name please ?

15 years ago, you say? Were you a user of the original Photosynth desktop app?

So basically , photogrammetry is still king when it comes to realtime applications (games) as it holds the detail even up close and you can retopo it later, and things like gausiang splatting are currently good for video production/vfx, correct ?

4k60fps video. But you recorded your Desktop in 720p or what?

the main problem with GS its that i cant work with the model,,, i have no geometry to work with... at the end of the day y have a geometro model with a texture that i can modify and use in a 3d enviroment i create...

whats wrong with the resulotion?

Hey Matt, very interesting man, just a note, you gotta practice more the delivery, it is slow, hessitative and it almost feels like either you have no idea what you are presenting or you do not recall properly how the whole process works, maybe rehearsing or doing takes and then re-edit?, cause as of right now, this version is lethargically slow.

I hereby dub this rock...The 890 JUMP 😉