Right?! Thanks for letting me know you appreciate the settings for optimal capture. I almost didn't put it in because I thought people might find it too boring.
You're absolutely right. The technique has just gotten to the point where it is usable and there are thankfully plugins built to use gaussian splats in programs like After Effects, Blender, and Unreal Engine 5.
It´s so cool that technology is evolving. I´m not that good at 3d modeling and I don´t have enough time to learn what I want to do. What I am waiting for is a tool that I can use to bring a 3d model of my own custom built car to Assetto Corsa and maybe in the future make my own racetracks. There are tools already to make it easier and this is definetly a step towards that. I wish in the future there will be software that I can just make a route in Google Maps and the software will use street view images to generate the 3d model. Or feed the software a video and gps data of a route I want modeled. Future is so cool.
Great video. Very cool tech. It would be nice to see the geo without the texture on it as well. Texture can make the geo look more detailed than it really is.
Year after year that awesome Black Mixture dude with awesome voice helps me tremendously with technics, methods, explanations over and over again, thank you Black Mixture dude
Man, movies are going to be legit in another 10 years. Imagine studios filming an entire movie and then converting it into a 3D model and placing you in the movie with VR.
I was wondering the same. My experience with photogrammetry has been extremely 'meh.' It literally can't even replicate a straight line. This process appears to be significantly better but of course I haven't tried it yet.
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
@@AlternativeCutsStudios Yes, I noticed this myself - however as a method to produce a 3D model that you could shrink wrap a mesh over to create an animatable model - I think it will be great.
gaussian splatting is a lot of fun but super experimental. I used it for a client music video but I will promise it is gonna give you headaches for sure. I used luma ai and UE5
The meshes tend to be vert heavy with bad normals. Its not really useful for gaming as claimed unless you consider adding mesh fixing to your modelling workflow "good."
I have the Kiri Engine on my phone and it works the same way as this video. If you subscribe to the pro version, you can export meshes, PBR material sets and everything. You can use many features for free.
Isn't Kiri Engine Chinese owned? I guess I'm just worried about having something like that on the same phone I have my banking app on. I have a separate Tablet with nothing attached - I guess I could put that alongside Scaniverse (I like Scaniverse as it keeps the processing local to my computer and doesn't send my data off to someone else's cloud storage and all that means for Ai "training")
Do you think this would work with existing city flyovers for a city model? I'm sure drone footage would be good, but I'm curious because there are so many lens distortions that may get this wrong. That brings up another question, lens, what mm in terns of macro vs fish eye or in between. Wonderful video!!
Yooo I actually did this with some old drone footage that was NOT intended for 3D gaussian splats and it came out awesome! I highly recommend this for city flyovers with drone footage. The lens wasn't a fisheye and was basic DJI drone.
You should look into 4D Gaussian splatting. Its animated Gaussian spatting. Thats the future. But I dont think this will come for gaming anytime soon, because it takes a sh*t ton of space.
How is that a “technical correction”? Seems more like you having a personal objection to a word being used in a particular way. Which, you’re free to have, of course. I think it would be better if you described it as a preference though. That’s what I would prefer.
@Black Mixture Hi, can you tell me what phone you used to film the fire hydrant? The video quality looks really good, I'm not happy with my iphone 12 at 4k 60, the footage always looks really bad.
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
Wish you had actually shown the wireframe of the models produced with this method. I bet they are very messy and will require a lot of retopology to make it work in a pipeline
Nice, but my understanding is that it's quite difficult to generate a 3D mesh from this - splats are not really 3D in the conventional sense. Photogrammetry still rules the roost on this (for now).
Problem is that gausian splatting cant be exported as polygons .(for now) So currently no use in games .( for now ) Make walking simulators great again haha .
@@beziergrin Yep. That is a difficult one. It had a shorter name once, but tourism became important. And there is of course this one: Taumatawhakatangihangakoauauotamateapokaiwhenuakitanatahu
9/10 videos don't give you the damn settings for optimal capture. Thank you for doing this right from the start!
Right?! Thanks for letting me know you appreciate the settings for optimal capture. I almost didn't put it in because I thought people might find it too boring.
Holy crap, this will work better than mirrors to trim the back of my neckline.
Tyrone Clones Himself. Scary good. Thanks for a detailed tute!
Gaussian splatting is something that's been around for a hot minute already. Its just much better now than it was when it first hit the world.
You're absolutely right. The technique has just gotten to the point where it is usable and there are thankfully plugins built to use gaussian splats in programs like After Effects, Blender, and Unreal Engine 5.
2:49 The Desktooooooppp :D Holy
Dude, this is everything I've been looking for! Thank you for showing me this. God bless to you my friend!
You mean you have no abilities and looking for something to do everything for you?
@@flinfaraday1821 Precisely, and the exact reason why you're watching this video
I did NOT expect that voice to come from that face. lol Good stuff dude! Thanks for sharing!
me too.
Don’t be racist.
@@doclee8755 Such narrow mindedness.
@@doclee8755how were they being racist?
I swear I thought the same
It´s so cool that technology is evolving. I´m not that good at 3d modeling and I don´t have enough time to learn what I want to do. What I am waiting for is a tool that I can use to bring a 3d model of my own custom built car to Assetto Corsa and maybe in the future make my own racetracks. There are tools already to make it easier and this is definetly a step towards that. I wish in the future there will be software that I can just make a route in Google Maps and the software will use street view images to generate the 3d model. Or feed the software a video and gps data of a route I want modeled. Future is so cool.
Great video. Very cool tech.
It would be nice to see the geo without the texture on it as well. Texture can make the geo look more detailed than it really is.
Year after year that awesome Black Mixture dude with awesome voice helps me tremendously with technics, methods, explanations over and over again, thank you Black Mixture dude
Haha thanks! Appreciate it your support 😁🔥
Thank you for your work and your video. I've been trying to do this for months, thank you so much!
Awesome glad it could help!
Man, movies are going to be legit in another 10 years. Imagine studios filming an entire movie and then converting it into a 3D model and placing you in the movie with VR.
That would be amazing.
@@TorQueMoD I love how you think 👍🏿
I hope in 10 years we will have good movies. Don't care how they are made.
10 years? This will be happening in 2
@@webinatic216 Couldn't agree more.. even if production techniques change, story will always still be king
i'd love to see this used on older photos (or multiple photos) to recreate a place from 30 or even 60 years ago (or older)
Thank you.
Educational and interesting, as usual. 👍 I'm curious about splats to meshes, and how they compare to photogrammetry. Any difference?
I was wondering the same. My experience with photogrammetry has been extremely 'meh.' It literally can't even replicate a straight line. This process appears to be significantly better but of course I haven't tried it yet.
@@aldermediaproductions695did you try it, the preview was so misleading showing the car triangulated
Very nice. It would be really cool if we could involve this in a 3d printing workflow.
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
@@AlternativeCutsStudios Yes, I noticed this myself - however as a method to produce a 3D model that you could shrink wrap a mesh over to create an animatable model - I think it will be great.
Looking forward to Davinci Resolve version
Great video. Good results!
do you have a video on the process of going from a splat to a more standard model in blender?
Very impressiv!
gaussian splatting is a lot of fun but super experimental. I used it for a client music video but I will promise it is gonna give you headaches for sure.
I used luma ai and UE5
dude thank you
Is the video posted somewhere? I’d like to see it!
This was awesome.
Marvelous Tech!
how do I make a mesh from a splat?
the whole point is that you don’t/can’t. that’s why it’s been around for a while but no one does anything with it. it’s the graphine of the cg world
That’s coming with 4D splats
The meshes tend to be vert heavy with bad normals. Its not really useful for gaming as claimed unless you consider adding mesh fixing to your modelling workflow "good."
nvidia has developed an ai tool that converts PointClouds to mesh, hopefully it'll become publicly available soon.
that delorean model was... special
I have the Kiri Engine on my phone and it works the same way as this video. If you subscribe to the pro version, you can export meshes, PBR material sets and everything. You can use many features for free.
Isn't Kiri Engine Chinese owned? I guess I'm just worried about having something like that on the same phone I have my banking app on. I have a separate Tablet with nothing attached - I guess I could put that alongside Scaniverse (I like Scaniverse as it keeps the processing local to my computer and doesn't send my data off to someone else's cloud storage and all that means for Ai "training")
Cool tech. 'Gauss' is to rhyme with Mouse. It is after a famous mathematician.
Thanks this will definitely help me remember it! I think I heard gaussian pronounced like gawshin years ago and it just stuck lol.
I learned something today 👌🏾
Do you think this would work with existing city flyovers for a city model? I'm sure drone footage would be good, but I'm curious because there are so many lens distortions that may get this wrong. That brings up another question, lens, what mm in terns of macro vs fish eye or in between. Wonderful video!!
Yooo I actually did this with some old drone footage that was NOT intended for 3D gaussian splats and it came out awesome! I highly recommend this for city flyovers with drone footage. The lens wasn't a fisheye and was basic DJI drone.
@@BlackMixture Nice!
Great video intro, thanks.
very cool, thanks
Dope Video!!!
Aye thanks!
You should look into 4D Gaussian splatting. Its animated Gaussian spatting. Thats the future.
But I dont think this will come for gaming anytime soon, because it takes a sh*t ton of space.
hi! great video... but. how export with texture to sketchfab? o blender? i want share 3d model in my webiste...
i want create a file similar in lumalabs
I would definitely like to implement this on future projects.
Sidenote: what is the intro song you used? from here 0:53 sounds like Finesto
Great video, could you 3d print them?
Really cool.
Small technical correction. The software is not ‘trained’. It performs analysis and provides a result.
How is that a “technical correction”? Seems more like you having a personal objection to a word being used in a particular way.
Which, you’re free to have, of course.
I think it would be better if you described it as a preference though. That’s what I would prefer.
Cool! Any clue about a macOS version or similar application for M-series Macs?
Hey, love the content, im having some difficulty installing the blender addon, is it compatible with blender 4.1?
Hey Nunosousa! It doesn't work on 4.1. Try downgrading to 4.0.0 and it should work there
daaang..... things be getting scary for traditional photogrammetrists
This might bring some light to the jfk-recordings
You made a nice video but why click baiting people with that thumbnail...
@@iresineherb7 oh so gaussian splitting can give u that sort of topology? Or all the parts as separate mesh?
If you select the nerf options could you make meshes off it.
@Black Mixture Hi, can you tell me what phone you used to film the fire hydrant? The video quality looks really good, I'm not happy with my iphone 12 at 4k 60, the footage always looks really bad.
LMFAO... I did not expect to see a person like you with a voice like that. 😅
A couple of questions: Is it possible to derive a 3d model from a splat, and is it possible to insert a 3d model into a splat?
awesome
Doraemon stuff getting real
What kind of computer are you running the training on, apart from the MONSTER GPU you got? :D
Is there a way to "convert" gaussian splat to geometry?
Maybe by doing a virtual photogrammetry within the gaussian scene? 🤔
MATHS
ask chatgpt
You didn't actually put a link in the description though
another great video
Thanks, glad you enjoyed it!
What's your recommended tool/software for generating 3D of actual cars?
Could you use the Gaussian as a texture, making a retopologized version in Blender?
Could this be used to scan a room instead of a single object?
Is there any way to get dimensional accuracy with this? or an easy/simple way at least?
Include a measuring stick somewhere in the scene.
It is Nvidia GPU only. Are there other alternative tools?
Postshot is Windows only??
Sadly there isn't any converter from guassian splatting to the classical mesh geometry, so the items can't move, limited to still life videos
It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great
Is there any way to use this data with DaVinci Resolve Studio?
Postshot does not work with GPUs pre RTX 2060, My GTX 1070 is out of list =(
OMG... "Blade Runner" becomes reality.
Have you tried this with video game footage?
WOW !
I don't like the registration process, it even fails on my password (from the firefox password generator.) .. so I could not test ... It's a pity.
Is there an app that just stabelizes cameratracks in videos using a gaussian splatting algorithm?
This is photogrammetry. Videos are also in essence just pictures. 😂😂
No it's not, with photogrammetry you create a mesh and the project a texture onto that mesh. Gaussian splatting creates a coloured point cloud.
When this is imported into Blender, I assume it can be converted to a mesh, yes?
Yay... photogrametry. It is like 10+ years on the market.
Photogrammetry is similar but the difference with gaussian Splatting is using model training to fill in the blanks.
Not the same thing
I mess with photogrammetry for about that time and it never looked so good!!
Without any reading or research, can you make 3D from old videos?
Your car render on the thumbnail had a wireframe though...
I don't suppose you can animate the characters. Looks like one mesh. Not useful for animation.
Cool though. But what is it good for?
I can not find post shot. That invitation is expired.
I'm going to stop learning new 3D art techniques for a few years until the AI craziness settles a bit!
My man…you’re allowed more than 3 folders on a desktop…just in case you were unsure. 😂
Can these be converted to mesh for or in blender?
Wish you had actually shown the wireframe of the models produced with this method. I bet they are very messy and will require a lot of retopology to make it work in a pipeline
what's the difference between this and reality capture's import video option?
Nice, but my understanding is that it's quite difficult to generate a 3D mesh from this - splats are not really 3D in the conventional sense. Photogrammetry still rules the roost on this (for now).
am i right in thinking this is what lumalabs luma app does or is it nerfs?
Can you save image as obj
10 years from now we won’t be able to tell what’s real.
Too high demands on graphics card.
Is it possible to export these splats as a standard 3d model.
Is it possible to use 360 Videos?
El Aleph
hello will a RX5700 XT work with this? when i try to load Post spots it says Faild to load Nvidia Cuda driver?
You need a GeForce card, Cuda drivers are an nVidia thing.
How do u convert it to a mesh
Is it on mobile app
It's very impressive. But I'm not sure I understand the difference between this and photogrammetry :/
In photogrammetry, you can't capture reflective items.
Joke post ? You have seen Gaussian splats and photogrammetry side by side ?
Photogrammetry is real geometry, using polygons. Splatting, uses blurry spots of the original image in 3d space, but there is no 3d polygons.
@@rekad8181 Thanks for the explanation.
Don't see how to put it to good use, unless it can be made to 3d mesh
It can
"FAILED TO SELECT IMAGES" ...any idea?
"It runs super fast"
Bro you're on a fu**ing RTX 4090, not sure that saying it runs fast is a fair thing to say lol
Problem is that gausian splatting cant be exported as polygons .(for now) So currently no use in games .( for now )
Make walking simulators great again haha .
It won't work when the target is in action. e.g. a moving cat.
I wish this worked for mac
Wish it had support for AMD gpus
Please never pronounce Gaussian like Gawshen
Please never correct anyone's pronunciation
@@nathanaelcard Don’t be a fool, properly pronouncing someone’s name is the least you could do out of simple respect
@@beziergrin
Remember that when you reference München and København.
@@Traitorman..Proverbs26.11 I will forgive people on “Llanfairpwllgwyngyllgogerychwyrndrobwllllantysiliogogogoch”
@@beziergrin
Yep. That is a difficult one. It had a shorter name once, but tourism became important.
And there is of course this one:
Taumatawhakatangihangakoauauotamateapokaiwhenuakitanatahu
No mesh
"How is it different from photogrammetry?"