Right?! Thanks for letting me know you appreciate the settings for optimal capture. I almost didn't put it in because I thought people might find it too boring.
Man, movies are going to be legit in another 10 years. Imagine studios filming an entire movie and then converting it into a 3D model and placing you in the movie with VR.
Year after year that awesome Black Mixture dude with awesome voice helps me tremendously with technics, methods, explanations over and over again, thank you Black Mixture dude
You're absolutely right. The technique has just gotten to the point where it is usable and there are thankfully plugins built to use gaussian splats in programs like After Effects, Blender, and Unreal Engine 5.
Great video. Very cool tech. It would be nice to see the geo without the texture on it as well. Texture can make the geo look more detailed than it really is.
The meshes tend to be vert heavy with bad normals. Its not really useful for gaming as claimed unless you consider adding mesh fixing to your modelling workflow "good."
You can't as of now, but you can export a .ply (3d file with just the splash dots as vertices and colors as vertex colors) and try to create the mesh manually superimposed on the vertices positions, but it would be very time consuming. I suppose turning those dots into proper 3d meshes will come sooner than later since it's one of the most expected applications
It´s so cool that technology is evolving. I´m not that good at 3d modeling and I don´t have enough time to learn what I want to do. What I am waiting for is a tool that I can use to bring a 3d model of my own custom built car to Assetto Corsa and maybe in the future make my own racetracks. There are tools already to make it easier and this is definetly a step towards that. I wish in the future there will be software that I can just make a route in Google Maps and the software will use street view images to generate the 3d model. Or feed the software a video and gps data of a route I want modeled. Future is so cool.
Do you think this would work with existing city flyovers for a city model? I'm sure drone footage would be good, but I'm curious because there are so many lens distortions that may get this wrong. That brings up another question, lens, what mm in terns of macro vs fish eye or in between. Wonderful video!!
Yooo I actually did this with some old drone footage that was NOT intended for 3D gaussian splats and it came out awesome! I highly recommend this for city flyovers with drone footage. The lens wasn't a fisheye and was basic DJI drone.
as prep could you have dropped a white sheet under/around the hydrant and then recorded your clip? in order to block out and reduce the training of unwanted artifacts?
I have the Kiri Engine on my phone and it works the same way as this video. If you subscribe to the pro version, you can export meshes, PBR material sets and everything. You can use many features for free.
Isn't Kiri Engine Chinese owned? I guess I'm just worried about having something like that on the same phone I have my banking app on. I have a separate Tablet with nothing attached - I guess I could put that alongside Scaniverse (I like Scaniverse as it keeps the processing local to my computer and doesn't send my data off to someone else's cloud storage and all that means for Ai "training")
I was wondering the same. My experience with photogrammetry has been extremely 'meh.' It literally can't even replicate a straight line. This process appears to be significantly better but of course I haven't tried it yet.
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
@@AlternativeCutsStudios Yes, I noticed this myself - however as a method to produce a 3D model that you could shrink wrap a mesh over to create an animatable model - I think it will be great.
gaussian splatting is a lot of fun but super experimental. I used it for a client music video but I will promise it is gonna give you headaches for sure. I used luma ai and UE5
I've been seeing vids about gaussian splatting lately, it seems to be the big new 3D thing. I don't understand though, how is it different from photogrammetry? Apart from the fact that it doesn't actually build real geometry?
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
You should look into 4D Gaussian splatting. Its animated Gaussian spatting. Thats the future. But I dont think this will come for gaming anytime soon, because it takes a sh*t ton of space.
@Black Mixture Hi, can you tell me what phone you used to film the fire hydrant? The video quality looks really good, I'm not happy with my iphone 12 at 4k 60, the footage always looks really bad.
Wish you had actually shown the wireframe of the models produced with this method. I bet they are very messy and will require a lot of retopology to make it work in a pipeline
Nice, but my understanding is that it's quite difficult to generate a 3D mesh from this - splats are not really 3D in the conventional sense. Photogrammetry still rules the roost on this (for now).
How is that a “technical correction”? Seems more like you having a personal objection to a word being used in a particular way. Which, you’re free to have, of course. I think it would be better if you described it as a preference though. That’s what I would prefer.
Problem is that gausian splatting cant be exported as polygons .(for now) So currently no use in games .( for now ) Make walking simulators great again haha .
![Generate ENTIRE 3D SETS For Your Projects FAST! [FREE Blender + SDXL/FLUX Workflow]](http://i.ytimg.com/vi/U_NHijmIF3E/mqdefault.jpg)
9/10 videos don't give you the damn settings for optimal capture. Thank you for doing this right from the start!
Right?! Thanks for letting me know you appreciate the settings for optimal capture. I almost didn't put it in because I thought people might find it too boring.
Holy crap, this will work better than mirrors to trim the back of my neckline.
Man, movies are going to be legit in another 10 years. Imagine studios filming an entire movie and then converting it into a 3D model and placing you in the movie with VR.
That would be amazing.
@@TorQueMoD I love how you think 👍🏿
I hope in 10 years we will have good movies. Don't care how they are made.
10 years? This will be happening in 2
@@webinatic216 Couldn't agree more.. even if production techniques change, story will always still be king
Dude, this is everything I've been looking for! Thank you for showing me this. God bless to you my friend!
You mean you have no abilities and looking for something to do everything for you?
@@flinfaraday1821 Precisely, and the exact reason why you're watching this video
Year after year that awesome Black Mixture dude with awesome voice helps me tremendously with technics, methods, explanations over and over again, thank you Black Mixture dude
Haha thanks! Appreciate it your support 😁🔥
I did NOT expect that voice to come from that face. lol Good stuff dude! Thanks for sharing!
me too.
Don’t be racist.
@@doclee8755 Such narrow mindedness.
@@doclee8755how were they being racist?
I swear I thought the same
Gaussian splatting is something that's been around for a hot minute already. Its just much better now than it was when it first hit the world.
You're absolutely right. The technique has just gotten to the point where it is usable and there are thankfully plugins built to use gaussian splats in programs like After Effects, Blender, and Unreal Engine 5.
it reminds me of NERF's I think it is called. Still amazing :O
Thank you for your work and your video. I've been trying to do this for months, thank you so much!
Awesome glad it could help!
Cool! Any clue about a macOS version or similar application for M-series Macs?
Great video. Very cool tech.
It would be nice to see the geo without the texture on it as well. Texture can make the geo look more detailed than it really is.
how do I make a mesh from a splat?
the whole point is that you don’t/can’t. that’s why it’s been around for a while but no one does anything with it. it’s the graphine of the cg world
That’s coming with 4D splats
The meshes tend to be vert heavy with bad normals. Its not really useful for gaming as claimed unless you consider adding mesh fixing to your modelling workflow "good."
nvidia has developed an ai tool that converts PointClouds to mesh, hopefully it'll become publicly available soon.
You can't as of now, but you can export a .ply (3d file with just the splash dots as vertices and colors as vertex colors) and try to create the mesh manually superimposed on the vertices positions, but it would be very time consuming. I suppose turning those dots into proper 3d meshes will come sooner than later since it's one of the most expected applications
It´s so cool that technology is evolving. I´m not that good at 3d modeling and I don´t have enough time to learn what I want to do. What I am waiting for is a tool that I can use to bring a 3d model of my own custom built car to Assetto Corsa and maybe in the future make my own racetracks. There are tools already to make it easier and this is definetly a step towards that. I wish in the future there will be software that I can just make a route in Google Maps and the software will use street view images to generate the 3d model. Or feed the software a video and gps data of a route I want modeled. Future is so cool.
do you have a video on the process of going from a splat to a more standard model in blender?
2:49 The Desktooooooppp :D Holy
I have the entire desktop filled and my icons are smaller!!! :)
😂😅@@maciejgorski6981
Thank you for the video! What project is that at 2:28 with the Apache Attack Helicopter?
If you select the nerf options could you make meshes off it.
Do you think this would work with existing city flyovers for a city model? I'm sure drone footage would be good, but I'm curious because there are so many lens distortions that may get this wrong. That brings up another question, lens, what mm in terns of macro vs fish eye or in between. Wonderful video!!
Yooo I actually did this with some old drone footage that was NOT intended for 3D gaussian splats and it came out awesome! I highly recommend this for city flyovers with drone footage. The lens wasn't a fisheye and was basic DJI drone.
@@BlackMixture Nice!
Looking forward to Davinci Resolve version
i'd love to see this used on older photos (or multiple photos) to recreate a place from 30 or even 60 years ago (or older)
Thank you.
as prep could you have dropped a white sheet under/around the hydrant and then recorded your clip? in order to block out and reduce the training of unwanted artifacts?
I would definitely like to implement this on future projects.
Sidenote: what is the intro song you used? from here 0:53 sounds like Finesto
Can this be done with 360 images or video? 😊
You didn't actually put a link in the description though
Could this be used to scan a room instead of a single object?
Postshot is Windows only??
Could you use the Gaussian as a texture, making a retopologized version in Blender?
I have the Kiri Engine on my phone and it works the same way as this video. If you subscribe to the pro version, you can export meshes, PBR material sets and everything. You can use many features for free.
Isn't Kiri Engine Chinese owned? I guess I'm just worried about having something like that on the same phone I have my banking app on. I have a separate Tablet with nothing attached - I guess I could put that alongside Scaniverse (I like Scaniverse as it keeps the processing local to my computer and doesn't send my data off to someone else's cloud storage and all that means for Ai "training")
Educational and interesting, as usual. 👍 I'm curious about splats to meshes, and how they compare to photogrammetry. Any difference?
I was wondering the same. My experience with photogrammetry has been extremely 'meh.' It literally can't even replicate a straight line. This process appears to be significantly better but of course I haven't tried it yet.
@@aldermediaproductions695did you try it, the preview was so misleading showing the car triangulated
Very nice. It would be really cool if we could involve this in a 3d printing workflow.
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
@@AlternativeCutsStudios Yes, I noticed this myself - however as a method to produce a 3D model that you could shrink wrap a mesh over to create an animatable model - I think it will be great.
A couple of questions: Is it possible to derive a 3d model from a splat, and is it possible to insert a 3d model into a splat?
What kind of computer are you running the training on, apart from the MONSTER GPU you got? :D
Tyrone Clones Himself. Scary good. Thanks for a detailed tute!
can you import a clip and images and train from that?
hi! great video... but. how export with texture to sketchfab? o blender? i want share 3d model in my webiste...
i want create a file similar in lumalabs
Can we use these 3D models in Maya or Blender?
What is the output file format of this program?
gaussian splatting is a lot of fun but super experimental. I used it for a client music video but I will promise it is gonna give you headaches for sure.
I used luma ai and UE5
dude thank you
Is the video posted somewhere? I’d like to see it!
Is there any way to get dimensional accuracy with this? or an easy/simple way at least?
Include a measuring stick somewhere in the scene.
What's your recommended tool/software for generating 3D of actual cars?
Great video. Good results!
Great video, could you 3d print them?
Couldn't you use a drone and scan your town?
I've been seeing vids about gaussian splatting lately, it seems to be the big new 3D thing.
I don't understand though, how is it different from photogrammetry? Apart from the fact that it doesn't actually build real geometry?
It is Nvidia GPU only. Are there other alternative tools?
Very impressiv!
Postshot does not work with GPUs pre RTX 2060, My GTX 1070 is out of list =(
Is it possible to export these splats as a standard 3d model.
This was awesome.
I learned something today 👌🏾
Sadly there isn't any converter from guassian splatting to the classical mesh geometry, so the items can't move, limited to still life videos
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
Marvelous Tech!
that delorean model was... special
Is it possible to use 360 Videos?
You should look into 4D Gaussian splatting. Its animated Gaussian spatting. Thats the future.
But I dont think this will come for gaming anytime soon, because it takes a sh*t ton of space.
Dope Video!!!
Aye thanks!
I don't like the registration process, it even fails on my password (from the firefox password generator.) .. so I could not test ... It's a pity.
Thanks man!
I can not find post shot. That invitation is expired.
am i right in thinking this is what lumalabs luma app does or is it nerfs?
Is there any way to use this data with DaVinci Resolve Studio?
When this is imported into Blender, I assume it can be converted to a mesh, yes?
Hey, love the content, im having some difficulty installing the blender addon, is it compatible with blender 4.1?
Hey Nunosousa! It doesn't work on 4.1. Try downgrading to 4.0.0 and it should work there
Is there an app that just stabelizes cameratracks in videos using a gaussian splatting algorithm?
Can these be converted to mesh for or in blender?
Is there a way to "convert" gaussian splat to geometry?
Maybe by doing a virtual photogrammetry within the gaussian scene? 🤔
MATHS
ask chatgpt
what's the difference between this and reality capture's import video option?
Can you save image as obj
How do u convert it to a mesh
Great video intro, thanks.
@Black Mixture Hi, can you tell me what phone you used to film the fire hydrant? The video quality looks really good, I'm not happy with my iphone 12 at 4k 60, the footage always looks really bad.
very cool, thanks
Without any reading or research, can you make 3D from old videos?
Have you tried this with video game footage?
daaang..... things be getting scary for traditional photogrammetrists
Cool tech. 'Gauss' is to rhyme with Mouse. It is after a famous mathematician.
Thanks this will definitely help me remember it! I think I heard gaussian pronounced like gawshin years ago and it just stuck lol.
Thanks!!
hello will a RX5700 XT work with this? when i try to load Post spots it says Faild to load Nvidia Cuda driver?
You need a GeForce card, Cuda drivers are an nVidia thing.
I don't suppose you can animate the characters. Looks like one mesh. Not useful for animation.
Cool though. But what is it good for?
Really cool.
This might bring some light to the jfk-recordings
Wish you had actually shown the wireframe of the models produced with this method. I bet they are very messy and will require a lot of retopology to make it work in a pipeline
Nice, but my understanding is that it's quite difficult to generate a 3D mesh from this - splats are not really 3D in the conventional sense. Photogrammetry still rules the roost on this (for now).
Doraemon stuff getting real
Is it on mobile app
Your car render on the thumbnail had a wireframe though...
another great video
Thanks, glad you enjoyed it!
LMFAO... I did not expect to see a person like you with a voice like that. 😅
You made a nice video but why click baiting people with that thumbnail...
@@iresineherb7 oh so gaussian splitting can give u that sort of topology? Or all the parts as separate mesh?
Too high demands on graphics card.
Small technical correction. The software is not ‘trained’. It performs analysis and provides a result.
How is that a “technical correction”? Seems more like you having a personal objection to a word being used in a particular way.
Which, you’re free to have, of course.
I think it would be better if you described it as a preference though. That’s what I would prefer.
"FAILED TO SELECT IMAGES" ...any idea?
awesome
It won't work when the target is in action. e.g. a moving cat.
OMG... "Blade Runner" becomes reality.
It's very impressive. But I'm not sure I understand the difference between this and photogrammetry :/
In photogrammetry, you can't capture reflective items.
Joke post ? You have seen Gaussian splats and photogrammetry side by side ?
Photogrammetry is real geometry, using polygons. Splatting, uses blurry spots of the original image in 3d space, but there is no 3d polygons.
@@rekad8181 Thanks for the explanation.
Don't see how to put it to good use, unless it can be made to 3d mesh
It can
This is photogrammetry. Videos are also in essence just pictures. 😂😂
No it's not, with photogrammetry you create a mesh and the project a texture onto that mesh. Gaussian splatting creates a coloured point cloud.
"It runs super fast"
Bro you're on a fu**ing RTX 4090, not sure that saying it runs fast is a fair thing to say lol
Wish it had support for AMD gpus
My man…you’re allowed more than 3 folders on a desktop…just in case you were unsure. 😂
Problem is that gausian splatting cant be exported as polygons .(for now) So currently no use in games .( for now )
Make walking simulators great again haha .