Right?! Thanks for letting me know you appreciate the settings for optimal capture. I almost didn't put it in because I thought people might find it too boring.
Man, movies are going to be legit in another 10 years. Imagine studios filming an entire movie and then converting it into a 3D model and placing you in the movie with VR.
You're absolutely right. The technique has just gotten to the point where it is usable and there are thankfully plugins built to use gaussian splats in programs like After Effects, Blender, and Unreal Engine 5.
Year after year that awesome Black Mixture dude with awesome voice helps me tremendously with technics, methods, explanations over and over again, thank you Black Mixture dude
Great video. Very cool tech. It would be nice to see the geo without the texture on it as well. Texture can make the geo look more detailed than it really is.
The meshes tend to be vert heavy with bad normals. Its not really useful for gaming as claimed unless you consider adding mesh fixing to your modelling workflow "good."
You can't as of now, but you can export a .ply (3d file with just the splash dots as vertices and colors as vertex colors) and try to create the mesh manually superimposed on the vertices positions, but it would be very time consuming. I suppose turning those dots into proper 3d meshes will come sooner than later since it's one of the most expected applications
It´s so cool that technology is evolving. I´m not that good at 3d modeling and I don´t have enough time to learn what I want to do. What I am waiting for is a tool that I can use to bring a 3d model of my own custom built car to Assetto Corsa and maybe in the future make my own racetracks. There are tools already to make it easier and this is definetly a step towards that. I wish in the future there will be software that I can just make a route in Google Maps and the software will use street view images to generate the 3d model. Or feed the software a video and gps data of a route I want modeled. Future is so cool.
as prep could you have dropped a white sheet under/around the hydrant and then recorded your clip? in order to block out and reduce the training of unwanted artifacts?
Do you think this would work with existing city flyovers for a city model? I'm sure drone footage would be good, but I'm curious because there are so many lens distortions that may get this wrong. That brings up another question, lens, what mm in terns of macro vs fish eye or in between. Wonderful video!!
Yooo I actually did this with some old drone footage that was NOT intended for 3D gaussian splats and it came out awesome! I highly recommend this for city flyovers with drone footage. The lens wasn't a fisheye and was basic DJI drone.
I was wondering the same. My experience with photogrammetry has been extremely 'meh.' It literally can't even replicate a straight line. This process appears to be significantly better but of course I haven't tried it yet.
I have the Kiri Engine on my phone and it works the same way as this video. If you subscribe to the pro version, you can export meshes, PBR material sets and everything. You can use many features for free.
Isn't Kiri Engine Chinese owned? I guess I'm just worried about having something like that on the same phone I have my banking app on. I have a separate Tablet with nothing attached - I guess I could put that alongside Scaniverse (I like Scaniverse as it keeps the processing local to my computer and doesn't send my data off to someone else's cloud storage and all that means for Ai "training")
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
@Black Mixture Hi, can you tell me what phone you used to film the fire hydrant? The video quality looks really good, I'm not happy with my iphone 12 at 4k 60, the footage always looks really bad.
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
@@AlternativeCutsStudios Yes, I noticed this myself - however as a method to produce a 3D model that you could shrink wrap a mesh over to create an animatable model - I think it will be great.
Nice, but my understanding is that it's quite difficult to generate a 3D mesh from this - splats are not really 3D in the conventional sense. Photogrammetry still rules the roost on this (for now).
Wish you had actually shown the wireframe of the models produced with this method. I bet they are very messy and will require a lot of retopology to make it work in a pipeline
You should look into 4D Gaussian splatting. Its animated Gaussian spatting. Thats the future. But I dont think this will come for gaming anytime soon, because it takes a sh*t ton of space.
gaussian splatting is a lot of fun but super experimental. I used it for a client music video but I will promise it is gonna give you headaches for sure. I used luma ai and UE5
How is that a “technical correction”? Seems more like you having a personal objection to a word being used in a particular way. Which, you’re free to have, of course. I think it would be better if you described it as a preference though. That’s what I would prefer.
Problem is that gausian splatting cant be exported as polygons .(for now) So currently no use in games .( for now ) Make walking simulators great again haha .
9/10 videos don't give you the damn settings for optimal capture. Thank you for doing this right from the start!
Right?! Thanks for letting me know you appreciate the settings for optimal capture. I almost didn't put it in because I thought people might find it too boring.
Holy crap, this will work better than mirrors to trim the back of my neckline.
I did NOT expect that voice to come from that face. lol Good stuff dude! Thanks for sharing!
me too.
Don’t be racist.
@@doclee8755 Such narrow mindedness.
@@doclee8755how were they being racist?
I swear I thought the same
Man, movies are going to be legit in another 10 years. Imagine studios filming an entire movie and then converting it into a 3D model and placing you in the movie with VR.
That would be amazing.
@@TorQueMoD I love how you think 👍🏿
I hope in 10 years we will have good movies. Don't care how they are made.
10 years? This will be happening in 2
@@webinatic216 Couldn't agree more.. even if production techniques change, story will always still be king
Dude, this is everything I've been looking for! Thank you for showing me this. God bless to you my friend!
You mean you have no abilities and looking for something to do everything for you?
@@flinfaraday1821 Precisely, and the exact reason why you're watching this video
Gaussian splatting is something that's been around for a hot minute already. Its just much better now than it was when it first hit the world.
You're absolutely right. The technique has just gotten to the point where it is usable and there are thankfully plugins built to use gaussian splats in programs like After Effects, Blender, and Unreal Engine 5.
it reminds me of NERF's I think it is called. Still amazing :O
Year after year that awesome Black Mixture dude with awesome voice helps me tremendously with technics, methods, explanations over and over again, thank you Black Mixture dude
Haha thanks! Appreciate it your support 😁🔥
Great video. Very cool tech.
It would be nice to see the geo without the texture on it as well. Texture can make the geo look more detailed than it really is.
how do I make a mesh from a splat?
the whole point is that you don’t/can’t. that’s why it’s been around for a while but no one does anything with it. it’s the graphine of the cg world
That’s coming with 4D splats
The meshes tend to be vert heavy with bad normals. Its not really useful for gaming as claimed unless you consider adding mesh fixing to your modelling workflow "good."
nvidia has developed an ai tool that converts PointClouds to mesh, hopefully it'll become publicly available soon.
You can't as of now, but you can export a .ply (3d file with just the splash dots as vertices and colors as vertex colors) and try to create the mesh manually superimposed on the vertices positions, but it would be very time consuming. I suppose turning those dots into proper 3d meshes will come sooner than later since it's one of the most expected applications
do you have a video on the process of going from a splat to a more standard model in blender?
It´s so cool that technology is evolving. I´m not that good at 3d modeling and I don´t have enough time to learn what I want to do. What I am waiting for is a tool that I can use to bring a 3d model of my own custom built car to Assetto Corsa and maybe in the future make my own racetracks. There are tools already to make it easier and this is definetly a step towards that. I wish in the future there will be software that I can just make a route in Google Maps and the software will use street view images to generate the 3d model. Or feed the software a video and gps data of a route I want modeled. Future is so cool.
as prep could you have dropped a white sheet under/around the hydrant and then recorded your clip? in order to block out and reduce the training of unwanted artifacts?
Thank you for the video! What project is that at 2:28 with the Apache Attack Helicopter?
If you select the nerf options could you make meshes off it.
Thank you for your work and your video. I've been trying to do this for months, thank you so much!
Awesome glad it could help!
Do you think this would work with existing city flyovers for a city model? I'm sure drone footage would be good, but I'm curious because there are so many lens distortions that may get this wrong. That brings up another question, lens, what mm in terns of macro vs fish eye or in between. Wonderful video!!
Yooo I actually did this with some old drone footage that was NOT intended for 3D gaussian splats and it came out awesome! I highly recommend this for city flyovers with drone footage. The lens wasn't a fisheye and was basic DJI drone.
@@BlackMixture Nice!
Looking forward to Davinci Resolve version
You didn't actually put a link in the description though
A couple of questions: Is it possible to derive a 3d model from a splat, and is it possible to insert a 3d model into a splat?
2:49 The Desktooooooppp :D Holy
I have the entire desktop filled and my icons are smaller!!! :)
😂😅@@maciejgorski6981
Cool! Any clue about a macOS version or similar application for M-series Macs?
It is Nvidia GPU only. Are there other alternative tools?
Could you use the Gaussian as a texture, making a retopologized version in Blender?
Postshot does not work with GPUs pre RTX 2060, My GTX 1070 is out of list =(
hi! great video... but. how export with texture to sketchfab? o blender? i want share 3d model in my webiste...
i want create a file similar in lumalabs
Could this be used to scan a room instead of a single object?
Educational and interesting, as usual. 👍 I'm curious about splats to meshes, and how they compare to photogrammetry. Any difference?
I was wondering the same. My experience with photogrammetry has been extremely 'meh.' It literally can't even replicate a straight line. This process appears to be significantly better but of course I haven't tried it yet.
@@aldermediaproductions695did you try it, the preview was so misleading showing the car triangulated
I would definitely like to implement this on future projects.
Sidenote: what is the intro song you used? from here 0:53 sounds like Finesto
I have the Kiri Engine on my phone and it works the same way as this video. If you subscribe to the pro version, you can export meshes, PBR material sets and everything. You can use many features for free.
Isn't Kiri Engine Chinese owned? I guess I'm just worried about having something like that on the same phone I have my banking app on. I have a separate Tablet with nothing attached - I guess I could put that alongside Scaniverse (I like Scaniverse as it keeps the processing local to my computer and doesn't send my data off to someone else's cloud storage and all that means for Ai "training")
Sadly there isn't any converter from guassian splatting to the classical mesh geometry, so the items can't move, limited to still life videos
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
@Black Mixture Hi, can you tell me what phone you used to film the fire hydrant? The video quality looks really good, I'm not happy with my iphone 12 at 4k 60, the footage always looks really bad.
I don't like the registration process, it even fails on my password (from the firefox password generator.) .. so I could not test ... It's a pity.
i'd love to see this used on older photos (or multiple photos) to recreate a place from 30 or even 60 years ago (or older)
Thank you.
Couldn't you use a drone and scan your town?
Great video, could you 3d print them?
What's your recommended tool/software for generating 3D of actual cars?
What kind of computer are you running the training on, apart from the MONSTER GPU you got? :D
Can we use these 3D models in Maya or Blender?
What is the output file format of this program?
Postshot is Windows only??
Is there any way to get dimensional accuracy with this? or an easy/simple way at least?
Include a measuring stick somewhere in the scene.
I can not find post shot. That invitation is expired.
can you import a clip and images and train from that?
Have you tried this with video game footage?
Very nice. It would be really cool if we could involve this in a 3d printing workflow.
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
@@AlternativeCutsStudios Yes, I noticed this myself - however as a method to produce a 3D model that you could shrink wrap a mesh over to create an animatable model - I think it will be great.
Is there any way to use this data with DaVinci Resolve Studio?
Very impressiv!
Is there an app that just stabelizes cameratracks in videos using a gaussian splatting algorithm?
This was awesome.
Nice, but my understanding is that it's quite difficult to generate a 3D mesh from this - splats are not really 3D in the conventional sense. Photogrammetry still rules the roost on this (for now).
Thanks man!
Great video. Good results!
Dope Video!!!
Aye thanks!
Wish you had actually shown the wireframe of the models produced with this method. I bet they are very messy and will require a lot of retopology to make it work in a pipeline
When this is imported into Blender, I assume it can be converted to a mesh, yes?
am i right in thinking this is what lumalabs luma app does or is it nerfs?
Is it possible to export these splats as a standard 3d model.
Marvelous Tech!
what's the difference between this and reality capture's import video option?
You should look into 4D Gaussian splatting. Its animated Gaussian spatting. Thats the future.
But I dont think this will come for gaming anytime soon, because it takes a sh*t ton of space.
I don't suppose you can animate the characters. Looks like one mesh. Not useful for animation.
Cool though. But what is it good for?
Without any reading or research, can you make 3D from old videos?
that delorean model was... special
gaussian splatting is a lot of fun but super experimental. I used it for a client music video but I will promise it is gonna give you headaches for sure.
I used luma ai and UE5
dude thank you
Is the video posted somewhere? I’d like to see it!
Too high demands on graphics card.
Can these be converted to mesh for or in blender?
Hey, love the content, im having some difficulty installing the blender addon, is it compatible with blender 4.1?
Hey Nunosousa! It doesn't work on 4.1. Try downgrading to 4.0.0 and it should work there
I learned something today 👌🏾
Is there a way to "convert" gaussian splat to geometry?
Maybe by doing a virtual photogrammetry within the gaussian scene? 🤔
MATHS
ask chatgpt
Great video intro, thanks.
Thanks!!
Your car render on the thumbnail had a wireframe though...
hello will a RX5700 XT work with this? when i try to load Post spots it says Faild to load Nvidia Cuda driver?
You need a GeForce card, Cuda drivers are an nVidia thing.
Can you save image as obj
Is it possible to use 360 Videos?
Cool tech. 'Gauss' is to rhyme with Mouse. It is after a famous mathematician.
Thanks this will definitely help me remember it! I think I heard gaussian pronounced like gawshin years ago and it just stuck lol.
very cool, thanks
Tyrone Clones Himself. Scary good. Thanks for a detailed tute!
Really cool.
How do u convert it to a mesh
This might bring some light to the jfk-recordings
It won't work when the target is in action. e.g. a moving cat.
You made a nice video but why click baiting people with that thumbnail...
@@iresineherb7 oh so gaussian splitting can give u that sort of topology? Or all the parts as separate mesh?
Doraemon stuff getting real
daaang..... things be getting scary for traditional photogrammetrists
Don't see how to put it to good use, unless it can be made to 3d mesh
It can
"FAILED TO SELECT IMAGES" ...any idea?
Small technical correction. The software is not ‘trained’. It performs analysis and provides a result.
How is that a “technical correction”? Seems more like you having a personal objection to a word being used in a particular way.
Which, you’re free to have, of course.
I think it would be better if you described it as a preference though. That’s what I would prefer.
another great video
Thanks, glad you enjoyed it!
It's very impressive. But I'm not sure I understand the difference between this and photogrammetry :/
In photogrammetry, you can't capture reflective items.
Joke post ? You have seen Gaussian splats and photogrammetry side by side ?
Photogrammetry is real geometry, using polygons. Splatting, uses blurry spots of the original image in 3d space, but there is no 3d polygons.
@@rekad8181 Thanks for the explanation.
Wish it had support for AMD gpus
LMFAO... I did not expect to see a person like you with a voice like that. 😅
Is it on mobile app
awesome
Problem is that gausian splatting cant be exported as polygons .(for now) So currently no use in games .( for now )
Make walking simulators great again haha .
No mesh
Gaussian splatting kinda sucks though because of relighting capabilities. But a step in the right direction
WOW !
OMG... "Blade Runner" becomes reality.
My man…you’re allowed more than 3 folders on a desktop…just in case you were unsure. 😂
I wish this worked for mac