Great presentation. Thank you very much. Hopefully technology develops fast so we can use a proof version of such solutions. Personally I would be grateful when Blender can clean up the .Ply model coming out of Spotshot. I then add my lighting or other objects inside an interior model for further use in 3Dvista .Glb file. Thank you once more.
Ollie, I love your explanations and have followed your journey with Gaussian Splats since you started. Keep up the great work and coverage. Greatly appreciate your innovation and insight. Keep it coming!😄
Great job. Thank you for bringing the old way to see you, and the way you talk is amazing. I wish if you could show how you make the ghost room and by pressing g it goes to the normal room
@@AndresArosemena I'm on NDA for that project until I't released so I can't show anything. Will be using 3DGS and Photogrammetry for digital environmental work and in NukeX Compositing.
WOW. This has probably been the most helpful RUclips video in quite a while. Gaussian Splatting has always been a sealed book for me (yes, that is entirely on me, I could've researched the material, it's clearly out there). This has the potential to revolutionize Real Estate visualization! Just gotta figure out a) sustainable workflows on non iOS devices b) a way to circumvent subscription models - I know, "ownership" is a term of a bygone era, but I hope there's at least a way to download and OWN your CREATIONS (i.e. freely integrate them into your own site on your own terms) Any chance you'll follow up with a detailed video on this? 😉 Thanks for sharing, again, this was REALLY insightful!
Hi Olli, great work as always! You were a big inspiration in my undergraduate dissertation on a comparative study between photogrammetry and Gaussian splatting, I’m curious to hear your ideas for Gaussian splatting in forensic science i.e. for use in police investigations and in courts.
This is by far the most useful video out there when it comes to gaussian splats. I can't wait until I can convert to mesh environments to optimize for standalone viewing. Isolating movement for 4D recordings and pasting into those for playback.... this would be amazing for capturing loved ones & moments
Great video! Just finished my thesis about 3DGS for Virtual Production and came to a similar conclusion. Use in VFX may be imminent. Note, that VP does refer to all real-time XR applications in the entertainment industry, not only LED wall ICVFX. A paper that has blown me away was the Gaussian Codec Avatars by Meta. Also a great prospect for future VP.
Hey Olli! Amazing video. I was wondering if you have any suggestions for web embedding? At the moment I have been using Luma, but I'm interesting on producing and hosting myself.
Great video, Ali, would you consider making a spine tutorial for GS creators - I have played with it, but I feel I’ve not comprehended it completely. I’m sure there are a few tricks that you can teach us all with spine.
Hi Olli, first off, thanks so much for the very well put together content you are producing, they are of great help and entertaining too! I have a question but it seems the answer is no from researching: Is it possible to train Gaussian splats from obj/glb etc models? In particular I am hoping to convert a Matterport - Matterpak obj model (and maybe using its corresponding texture jpgs), into gaussian splats. I would imagine that thus far software such as Postshot require the original images to train the splats, so I guess it's likely not an option. Any info would be greatly appreciated as I'm at a bit of a loss with finding out. Cheers!
in fact, I was just at an event where I was asked this same thing. In principle, it is possible to convert 360 images from Matterport to Gaussian Splatting format, but they must first be processed and extracted into smaller parts such as cubemap squares. Postshot does not yet understand the Equirectangular format and because of that it is important to convert frames out of 360 images without fisheye distortion. But creating a successful Gaussian model also depends on how densely the 360 images for the virtual tour are captured. How far are the camera recording points from each other? I have made my own video about the cubemap conversion. you can check it here: ruclips.net/video/hX7Lixkc3J8/видео.htmlsi=6qrAbyGYYZzYwHGN One way or another, the task is not easy, but it is worth trying.
@OlliHuttunen78 nice on, I'll check that out. It's always interesting getting into new tech like this at a relatively early stage. Just waiting to see how it evolves...thanks Olli
Do you think Spotshot will have a connection with others softwares like After Effects in the future: Da Vinci Resolve , The Foundry Nuke or Autodesk Flame ?
Polycam is easy and with it you can create certain quality of Gaussian Splatting models. With PostShot you see how the process go and you can train much better quality models because you are able to tweak the controls and train you model much further than the default setting that Polycam offers.
Thx! How do you adjust Splat Scale in Spline for your models imported from Postshot? When I import the model in Spline from Postshot each splat is tiny, like a point, and the resulting shape is semi transparent. In Postshot there is a slider to adjust this called Splat Scale. In spline it is imported as 0.1 scale instead of 1.0 like in Postshot for me.
Hm, this seems to be fixed if PLY is exported from new 0.3 Postshot instead of 0.28. However, splats look significantly better in Postshot still - in Spline now the individual splats seems too big resulting in flioating artifacts. I'll try retraining with a new version.
I reached out to the team of Postshot. I asked there is any possibility to convert a e57, rcs, ryp ---> to a ply. They said thei are planning it in the future. Here is my question. Do you know anything to connect the gaussian splatting with a LIDAR Scanner. Normally you get an ugly Pointcloud where you dont really much see anything, but if you could combine these technologies, that would be insane. Do you know anything that is already advanced enough to process a e57 file to a nice 3D gaussian splat model? Thanks!
I would need to use this technology in the fields of engineering and architecture. Being able to take measurements and work with it using CAD software. Does something like this exist?
while the "splatting" isn't available, the pointcloud can be loaded in certain CAD/Modelling programs - I use CloudCompare to convert these to LAS points see loading in ruclips.net/video/fCtOUtUCSmM/видео.html
Super informative brother
Thanks a lot! I’m just watching your latest podcast with Winbush and EJ. Great episode!
I see massive use potential for Guassian Splats replacing existing 3-D tours in the real estate industry.
Excellent explanation !!, didactic and updated, which demonstrates research on the subject, a summary that cannot be found in other channels.
Cannot Say better! Exact same thoughts
Great presentation. Thank you very much. Hopefully technology develops fast so we can use a proof version of such solutions. Personally I would be grateful when Blender can clean up the .Ply model coming out of Spotshot. I then add my lighting or other objects inside an interior model for further use in 3Dvista .Glb file. Thank you once more.
Great overview, Olli!
Ollie, I love your explanations and have followed your journey with Gaussian Splats since you started. Keep up the great work and coverage. Greatly appreciate your innovation and insight. Keep it coming!😄
Great job. Thank you for bringing the old way to see you, and the way you talk is amazing.
I wish if you could show how you make the ghost room and by pressing g it goes to the normal room
Bravo Olli for a great practical video about one of the hottest 3D tech of the moment
Great work Olli, your content never fails!
Awesome Olli!!! Thanks for sharing your view on the practical applications and use-cases! 👌🙏
Exactly what I was looking for!
Thanks for these videos. Keep them coming!
Thank you for another great production. Well done, Olli.
I'm using it in my VFX projects. Future is bright for 3DGS.
I just watched your tests on your channel, very cool stuff. Have you shared somewhere else your vfx shots where you used this technique?
@@AndresArosemena I'm on NDA for that project until I't released so I can't show anything. Will be using 3DGS and Photogrammetry for digital environmental work and in NukeX Compositing.
@@DaveDFX looking forward to when you are aloud to share them!
WOW. This has probably been the most helpful RUclips video in quite a while.
Gaussian Splatting has always been a sealed book for me (yes, that is entirely on me, I could've researched the material, it's clearly out there).
This has the potential to revolutionize Real Estate visualization!
Just gotta figure out
a) sustainable workflows on non iOS devices
b) a way to circumvent subscription models - I know, "ownership" is a term of a bygone era, but I hope there's at least a way to download and OWN your CREATIONS (i.e. freely integrate them into your own site on your own terms)
Any chance you'll follow up with a detailed video on this? 😉
Thanks for sharing, again, this was REALLY insightful!
Thanks for putting this together, Olli. I'm on this journey with you, deploying splats in an educational setting!
Brilliant! Thanks For such well organised roadmap in the world of Gaussian Splatting
Your videos are pure gold, thanks!
Hi Olli, great work as always! You were a big inspiration in my undergraduate dissertation on a comparative study between photogrammetry and Gaussian splatting, I’m curious to hear your ideas for Gaussian splatting in forensic science i.e. for use in police investigations and in courts.
Thanks for overviewing the splatting world!
This is by far the most useful video out there when it comes to gaussian splats.
I can't wait until I can convert to mesh environments to optimize for standalone viewing. Isolating movement for 4D recordings and pasting into those for playback.... this would be amazing for capturing loved ones & moments
Amazing overview Olli. Hopefully I can get aboard all this before everyone else does :D
I have a feeling 3DVista is going to implement Gaussian Splats hopefully soon down the track ;-) thanks for your fabulous contributions
Scaniverse is amazing. I consistently find it to outperform Polycam despite being free.
Yes It's awesome ! No need to upload to cloud and the realtime points in the viewer when scanning helps a lot.
@@DaveDFX I've just tried the new Gaussian Splatting feature and it's incredible. And that's being processed *on a phone!*
Great video, thanks for the incredible information
Very valuable video, thanks.
Thanks Olli, there are some things here I hadn't heard of
Great overview! Much appreciated!
Thank you for this :)
great video as always, thanks for sharing your experiments and insights
Great overview! Thanks
Thank you so much, this is incredibly helpful
We have released a cool plugin for After Effects to work with GS3D
Hi Olli! Amazing work! Btw INRIA is also adding VR support in their Github repo
Great video! Just finished my thesis about 3DGS for Virtual Production and came to a similar conclusion. Use in VFX may be imminent.
Note, that VP does refer to all real-time XR applications in the entertainment industry, not only LED wall ICVFX. A paper that has blown me away was the Gaussian Codec Avatars by Meta. Also a great prospect for future VP.
I hope you can share more experiences related to 3DGS and virtual production
Hey, is there a way I can read your thesis? I am working on 3DGS for my thesis too :)
@@bethany-rp2tq Hi, sorry just saw this. Is it still relevant for you? You can text me your email:)
@@bethany-rp2tqHi, sorry just saw this. If it is still relevant for you, you can send me your email:)
Hey Olli! Amazing video. I was wondering if you have any suggestions for web embedding? At the moment I have been using Luma, but I'm interesting on producing and hosting myself.
Thank you for sharing
Great video, Ali, would you consider making a spine tutorial for GS creators - I have played with it, but I feel I’ve not comprehended it completely. I’m sure there are a few tricks that you can teach us all with spine.
you can also edit the .ply file in blender
Thanks for this insight
Thanks for all your research! How far away do you think we are from animating splats?
Hi Olli, first off, thanks so much for the very well put together content you are producing, they are of great help and entertaining too! I have a question but it seems the answer is no from researching: Is it possible to train Gaussian splats from obj/glb etc models? In particular I am hoping to convert a Matterport - Matterpak obj model (and maybe using its corresponding texture jpgs), into gaussian splats. I would imagine that thus far software such as Postshot require the original images to train the splats, so I guess it's likely not an option. Any info would be greatly appreciated as I'm at a bit of a loss with finding out. Cheers!
in fact, I was just at an event where I was asked this same thing. In principle, it is possible to convert 360 images from Matterport to Gaussian Splatting format, but they must first be processed and extracted into smaller parts such as cubemap squares. Postshot does not yet understand the Equirectangular format and because of that it is important to convert frames out of 360 images without fisheye distortion. But creating a successful Gaussian model also depends on how densely the 360 images for the virtual tour are captured. How far are the camera recording points from each other? I have made my own video about the cubemap conversion. you can check it here: ruclips.net/video/hX7Lixkc3J8/видео.htmlsi=6qrAbyGYYZzYwHGN
One way or another, the task is not easy, but it is worth trying.
@OlliHuttunen78 nice on, I'll check that out. It's always interesting getting into new tech like this at a relatively early stage. Just waiting to see how it evolves...thanks Olli
Scaniverse is out for Android now.
I wonder if you could create High Dynamic Range Gaussian Splats and use them in 3D modelling workflows to replace traditional HDRIs.
Do you think Spotshot will have a connection with others softwares like After Effects in the future: Da Vinci Resolve , The Foundry Nuke or Autodesk Flame ?
Also I noticed your UE5 character interacting with the car. Did you figure out mesh conversion?
top channel! go Fin!
Is it worth it to learn Postshot over using Polycam? Can you tell a huge difference? Thanks Olli.
Polycam is easy and with it you can create certain quality of Gaussian Splatting models. With PostShot you see how the process go and you can train much better quality models because you are able to tweak the controls and train you model much further than the default setting that Polycam offers.
@@OlliHuttunen78 You're the best.
LOVE IT
Love your English :)) thanks for wrk!
i think you are missing the piece where the video output of lumia can be fed into stable diffusion to create AI videos
I hope Scaniverse comes to android.
Thx! How do you adjust Splat Scale in Spline for your models imported from Postshot? When I import the model in Spline from Postshot each splat is tiny, like a point, and the resulting shape is semi transparent. In Postshot there is a slider to adjust this called Splat Scale. In spline it is imported as 0.1 scale instead of 1.0 like in Postshot for me.
Hm, this seems to be fixed if PLY is exported from new 0.3 Postshot instead of 0.28. However, splats look significantly better in Postshot still - in Spline now the individual splats seems too big resulting in flioating artifacts. I'll try retraining with a new version.
huge thx
That is real cool.
Amazing Thx a Lot 🤯
I reached out to the team of Postshot.
I asked there is any possibility to convert a e57, rcs, ryp ---> to a ply.
They said thei are planning it in the future.
Here is my question.
Do you know anything to connect the gaussian splatting with a LIDAR Scanner.
Normally you get an ugly Pointcloud where you dont really much see anything, but if you could combine these technologies, that would be insane.
Do you know anything that is already advanced enough to process a e57 file to a nice 3D gaussian splat model?
Thanks!
What types of software can we use to render and view 4D GS for dynamic scenes where there is motion in the scene?
Bravo!
What music did you use, it's a bop
we need like an instagram for splatts. probably be best for VR/XR viewing.
I would need to use this technology in the fields of engineering and architecture. Being able to take measurements and work with it using CAD software. Does something like this exist?
while the "splatting" isn't available, the pointcloud can be loaded in certain CAD/Modelling programs - I use CloudCompare to convert these to LAS points see loading in ruclips.net/video/fCtOUtUCSmM/видео.html
@@briandavis4866 Thanks a lot!
Thanks Olli thats great, I know that Nvidia Omniverse has plans to add it. Dont have a timeline for that....
8:09 Skeletor?
Please remove this painful background music. It is wortless, and ruins the quality of the video. Thank you.
Calm down. 😂😂 Not nearly that serious.
Excellent video 🙂👍