What is 3D Gaussian Splatting?
HTML-код
- Опубликовано: 7 фев 2025
- How does 3D Gaussian Splatting work? It's kinda complex but we are gonna break it down for you in 3 minutes.
3D Gaussian Splatting for Real-Time Radiance Field Rendering Paper:
repo-sam.inria...
Shoutout to Maged for the Pyramids Drone footage
Shoutout to Jutsin for the Castell de Verdera Drone footage:
/ jaylpage
Join our discord server:
/ discord
If you wanna see us to do cool things follow us here too:
Instagram: / badxstudio
Twitter: / badxstudio
TikTok: / badxstudio
LinkedIn: / badxstudio
Bad Decisions Podcast 🎙️:
podcasters.spo...
Our personal handles: (if you wanna stalk us)
/ farhad_sh
/ farazshababs
/ farhads__
/ farazshababi
/ farhadshababi
/ farazshababi
#3dgaussiansplatting #3dscan #gaussiansplatting #3d #3drender #nerf #unrealengine5 #unrealengine #blender3d #blender #drone #ai
Wow this is an insane amount of information that was delivered in such a small amount of time. Loved your passion for it as well and the animations throughout!
Means a lot bro
Gaussian splatting is truly amazing, definitely one of the best research works in computer vision this year
totally agree.. one of the best papers release this year.
actually gaussian splatting has been around for about 8 years, it just wasnt called that, and it was back when a 1080ti was considered a strong gpu, before lots and lots of pipeline and processing breakthroughs
@@fnytnqsladcgqlefzcqxlzlcgj9220 Yeah but the previous works only used 3D Gaussian kernels for volume rendering. The first one was called EWA volume splatting, published in 2001, which heavily inspired the recent Gaussian splatting paper. This technique has been around for more than 20 years, but the recent Gaussian splatting paper is the first work that uses 3D Gaussian splatting on novel view synthesis. It combines Gaussian splatting with structure from motion (an already very mature field) and hardware acceleration, and it works surprising well, which is why it's such an exciting work. and it is still much more novel than any of those NeRF papers that try to squeeze that 20% of performance increase from neural networks.
Dayummm
I'm an intermediate game dev, you took me from no understanding to enough knowledge to start considering implementations in THREE MINUTES
that's a subscribe
genuinely appreciate your two's enthusiasm and informative contents!
Thanks for the love man. This comment means a lot and you know we are just going to keep goin!
Wow, very good 3 minute explanation. This is how explainers should be done, not a huge amount of useless prologue and also not too surface level, but actually explaining the intution behind the process, good job. I personally love math and CS so would've loved to see more in-depth coverage about the method, but that's what the paper is for and majority probably won't
Thank you so much for this reasoning as to why the video is resonating with you!
You know reading the paper ourselves we realised that a lot of people won't understand how this all works, so our goal was to simplify it as much as possible with visuals to ensure that almost anybody can understand it. We would have loved to go deeper, but were concerned that many beginners would be overwhelmed with the information overload.
you made it soooooo simple to understand!! I was trying to read the paper for the past 2 hours before coming across this video.
Guys what's your computer setup? Which CPU/GPU? How much RAM/VRAM? The docs say that 24 GB VRAM would be best, that's surely A LOT and 3x my current configuration
They say that would be best because the most powerful GPUs on the consumer market have 24 GB, I would say 12gb is enough. You could do it with 8 but that might push it
Heck yeah thanks for the best, most down to earth explanation of what the heck Gaussian Splatting is! Not sure about the term "gsplat" tho lol. Thanks for making this and keep it up fellas!!
Hahahahahahha Dude come on! Gplat is a perfectly fit acronym for it :D
Lol thanks for the love brother
Best best best short explanation about this technology that I have seen.
MAN, can't wait for you guys to use this method EVEN MORE in the future 🔥
New video coming out tomorrow night too ;)
Thank you for keeping it short yet super comprehensive! its 3 am rn for me and my exam is in 9 hours lol
That's the Lamplighter pub !! My late Uncle owned that place for 40 years and transformed it and the hotel..
Him and his brother had the steamclock rebuilt and its been kept up to this day!!
Whaaaaaaaaaat????? What a coincidence!!!! I've been to the Lamplighter one time with friends had a great time there. How did you end up on this video btw? Good to meet you!
@badxstudio I've been following for a while, I'm working on getting moving with this technology for game and film applications... I was the guy who said for everyone to "give the hair a day off"
I've been working in Film for over a decade and I see the shift happening.
If i hear that reverse gleam sound effect one more time... haha
Annoying in what was otherwise an amazing video guys well done! Got all the info down to a very short video :)
Always entertaining and very, very informative content from you two.. I feel wiser and blessed to have stumbled across your channel. 😃
That's awesome, thank you!
You guys always continue to impress me with each video, the information, entertainment, value and production is top tier!
Much appreciated brother
Thank you for actually showing it visually
favorite channel now 😍😍
Haha we are honoured bro
Thanks you were funny. And the gausian will be huge.
Beautifully explained! And in 3 minutes! 🔥
Incredible work as always friends 🔥
I look forward to the tutorial 🙌🙌⚡️
Thank you so much brother! Glad you enjoyed it
Exactly what I wanted to write, great explanation!
Truely amazing. Its such an exciting time.
100% agreed
You made it too easy to understand. Keep such videos coming. Best wishes from your new subscriber :)
Thank you so much brother
Very good guys! Very well done explaining video! Can't wait to see what kind of experiment you have had in Unreal with these gsplats.
Thanks a ton! The UE experiment is coming out tomorrow and next we are gonna jump on a LED Wall to test these
can't wait for y'alls Unreal Engine Gaussian Splatting video!
The video is 90% ready. Coming out tomorrow at the same time :)
Cant wait for the first Matrix :P Seriously...this is just great. I hope this technique will be in games the next years.
I KNOW RIGHT!!
I'm new here but the way this video was made is enough for me to subscribe 😂😂
That was a VERY good explanation thanks!
Welcome to our new UE plugin: "UEGaussianSplatting: 3D Gaussian Splatting Rendering Feature For UE"
You guys have to try gaussian splatting with a 360 Camera
It's actually a very similar idea to SDF fields.
thank you guys for this very succinct but thorough expanation :D
Our pleasure!
Nice video, thank you guys!
Loved it!
wow the gaussians look like galaxies
Right????
AMAZING breakdown
Thanks bro
The next Google Earth and Maps will be soo COOL
Amazing art God give u more years from OG caliber Amun
Thanks for always being there OG
Well done. Good breakdown of the process. Thank you.
Thank yoouuuu sir!! It's our pleasure :)
Very well done fellas I'll definately be sharing this around!
Did you guys see Polycam just announced they are doing splats now too
Thank youuuu brother for always being supportive and sharing.
Yeah just spoke to them and tested them last night. Have you played with it yet?
It's HELLA fast to view and looks pretty good considering we are not the one training it.
Why do I feel like this is a "Shark Tank" intro
came here cause i know the world is changin so damn fast🦋
Great choice hahaha..
great video - thank you!!!
Glad you liked it!
How powerful graphic card I need to run it on my own computer?@@badxstudio
So basically photogrammetry? What are the main differences? Lidar makes point cloud but it’s definetly more expensive, tho more precise.
aoh my god its awsome
I knowwww
Damn, amazing video!!!!
Thanks buddy
Hooray something new for Nvidia/AMD fans to argue about
Nice explanation
how big are the models in terms of data? compared to regular photogrammetry?
How did gradients become radiance? And where did the .named extensions go if they were required. Asking for the year 2000
is it possible to have pyramids dataset?
Great work as usual, keep it up guys!
Is there an end 2 end tutorial?
Thanks buddy… Coming soon ;)
Nice.
Where I found Latest News about VFX industry ,Is there any website I only know about Artstation
Meanwhile I'm thinking oh he mapped two different haircuts to his head for shits and giggles. Then there was the ending
Why are you guys talking like this? Be authentic and stop trying to make the mundane interesting but in this case this topic already has appeal.
How tomstart the app?😊
I need someone to answer this for me.
Would it be possible to use this technology with sunken ships that are at the bottom of the sea? If yes, how?
hmmmm maybe we should try to train an underwater object next
So, does this mean you can create a 2D image wirh Ai and then render it in 3D with this Gsplatting technique?
You guys are incredible!! Is this editable for VFX?
love ya brother!
Listen at the moment not really. You can either crop the scene with a bounding box or if you bring it to unreal using a plugin, you can edit the niagara particles (considering you know how).
So at the moment it's only good for rendering it as is and testing with it. But you can bet your butt that it will be becoming a whole lot more useful overtime as more people work on it!
@@badxstudio that's crazy, thank you so much guys
The 3D representation of a Gaussian is not an ellipsoid.
Otherwise, you would see elipsoids overlapping each other in the rendering. Instead, what you see is shapes that fade nicely one into another.
Why is that?
If you think of the Gaussian function in 1D as being what you've shown in the video (which is correct), in 3D is being used to describe opacity in all 3 dimensions.
That is, from the center of a 3D Gaussian to it's extent, the opacity follows a half Gaussian function.
In the case of an ellipsoid, this function would be a rectangular (it ends abruptly, creating a surface).
3D Gaussians don't have a surface because their density / opacity is described by, well.. a Gaussian function.
That makes them fit for conveying the idea of volumes, as they blend nicely one into another.
Then you may ask "Why the Gaussian function precisely?". Glad you asked.
The Gaussian function has some important properties.
The convolution between two Gaussians results in a Gaussian.
Multiple convolutions between rectangles (or any other function really) converge to a Gaussian function.
That makes them perfectly fit for blending, yielding the smoothest possible result.
The smoothest possible blur is - you guessed it - a Gaussian blur. That is, regardless of the blurring kernel of your choice when blurring an image, it eventually approximate the Gaussian blur.
That is a direct consequence of the convolution property, as blurring is actually a convolution between a clear image and a certain kernel and since convolution between almost any kernels eventually converge to a Gaussian kernel, the blurring does as well.
In short, think of a 3D Gaussian as being more like a cloud in which the deeper you go, the more dense / opaque it becomes and if you'll try to plot the density, a Gaussian function will emerge (half of it).
Hope that makes sense.
are your videos in HDR cause im getting off colors in 2k and i have sDR monitor just asking?
Excellent video. At 1:44, _ellipsoid_ is pronounced (ell - ip' - soid,) with the accent on the 2nd syllable. Regards.
Thanks for that G!
Imagine how many pictures a video will generate, so when i understand the principe of gaussian splatting correctly, so i guess an only object will have 1000 pictures.
… you lost me after adaptive density control lol, but super exciting! I’d like to know more about the technical stuff - such as can this be implemented in multiple softwares today (like UE5), is there a huge learning curve to implement this, how much memory does this task take up/what components does a computer need to implement this, etc.
yes there is a plugin for Unreal Engine, check out our latest video.
For training it locally you need GPU with min 24gb VRAM
DAT hair though!
Guys try the first matrix movie gun scene with neo
OOOOOoooooooh shizzzz that's a good idea! WILL TRY
Please make a tutorial video for creating a 3D scene using Gaussian Splatting and importing it into unreal engine and use Ultra Dynamic Sky with various other 3D objects in it.
ok half of what you asked is already done and is coming out tomorrow.
Is it possible to edit these gaussians or combine them with other gaussians from another shot? I’m going crazy over this tech
There is crop tools in UE plugin and you can bring multiple gaussians into one scene. However we are at the very early stage so we believe there will be more customization tool coming soon
@@badxstudio Damn I can’t wait for this tech to progress, please keep uploading more and keep your channel active I already love all your videos you’ve uploaded so far
When’s the tut coming?
Next Week :)
hm interesting, but i can't think of many usecases for this.
1) you can't model the stuff yourself, it only seems to work with stuff that's already there
2) these are static scenes, no change of lighting, texture animation or anything alse...
3) so not really usable for games
Hey guys, when will you have a video explaining how to do this taking into consideration what quality settings we should have on an iPhone to get this done? I followed the Nerf Guru and got all the software working but after like an hour or more it was still sitting at 5% training so I gave up, it was just a little room so Im sure im doing something wrong? my gpu is an RTX 4000 8gb. Also a question that I cant seem to find an answer for, are we able to export this into Unreal, Sketchup? How?
For sure, we will do a full breakdown of capture quality but please remember that all of these are experiments, just simple try and error.
And, yes there is a plugin for Unreal Engine, check out our latest video
are you able to use a Mac for this, or is it CUDA powered only?
I believe its only Nvidia gpu at the moment
Explained very nice, short, clear and to the point. A bit too much overacting maybe.
Could be fun if you publish your .ply somewhere so we can try out
If you want it, we can share it on our discord alongside all the other models. Just tag us there
Ho nice a Discord server. Yes I've tag you@@badxstudio
Minimum GPU RAM necessary?
24gb Vram to train. BUT polycam just announced their Gaussian Splatting tool which trains on their end. New video on that coming this weekend!
Good to hear I look forward to it.. @@badxstudio
This is me, and now in 3D 0-
what i wanna know is what AI tool this guy used to give him that long grey hair in some shots.
hahahhaha GeneticGPT
The GSplats, *giggles*, do you boys know how to find it?
make tutorial step by step for splatting
For sure!! Will happen
Maybe they’ll finally start on GTA 6
hahahah
So I could virtually walk around my neighborhood n shit like?
Plzz make a tutorial about how to distract concentration from ur crush 😂I'm almost in the last stage with 0% self-respect😪
hahaha! You want a tutorial for that?? :D :D Maybe your crush needs to do another livestream like before hahahah!
Thanks Tanjida
واقعا خیلی بد انگلیسی صحبت میکنید. خب مگه مجبورتون کردن؟ واقعا متوجهش نمیشم
Catalonia? It surely looks like Spain to me
It's still a middle man...like polygons...unlike pixel data constructs...
first :))
Yahiya our bro. GOAT
Hysterical appearance does not help learning. Chill the f out
Nobody hits the GSplat quite like you two
Hahahhaha made us lol :D