4D Gaussian Splatting

Поделиться
HTML-код
  • Опубликовано: 16 окт 2023
  • dynamic gaussians paper: dynamic3dgaussians.github.io/
    deformation fields paper: arxiv.org/abs/2310.08528
    join discord: hf.co/join/discord

Комментарии • 490

  • @smileyp4535
    @smileyp4535 8 месяцев назад +3926

    2 minute papers meet 30 second papers. What a time to be alive!

    • @hhjpegg
      @hhjpegg 8 месяцев назад +80

      60 second papers

    • @GeneralKenobi69420
      @GeneralKenobi69420 8 месяцев назад

      This is much more enjoyable than that other indian sounding ass. At least I don't have to watch at 2x speed so I don't fall asleep and skip the first half because it's just padding that everyone already knows about

    • @Mertiven
      @Mertiven 8 месяцев назад +42

      52.1 second papers

    • @fire17102
      @fire17102 8 месяцев назад +40

      52.477 second papers actually

    • @LocusFelix
      @LocusFelix 8 месяцев назад +14

      Hello Scholar

  • @Terraspark4941
    @Terraspark4941 2 месяца назад +237

    this has to be the best advertisement for a technology i wont directly interact with in the near future that i have seen

  • @vaels5682
    @vaels5682 9 месяцев назад +1264

    GAUSSIAN SPLATTING 2: ELECTRIC BOOGALOO

    • @shApYT
      @shApYT 8 месяцев назад +4

      Starring Jason Statham: featuring Jason Statham.

    • @lemontechkk
      @lemontechkk 8 месяцев назад +1

      💀

    • @spyral00
      @spyral00 8 месяцев назад +6

      @@shApYT Jason Splatham

    • @Coolguy_2491
      @Coolguy_2491 7 месяцев назад +5

      i still don't understand this joke , even after a month

    • @chaoticdilgins6675
      @chaoticdilgins6675 7 месяцев назад

      gaussian bukkake

  • @buggy5079
    @buggy5079 8 месяцев назад +275

    "but why does this matter, isn't it just a 3D video"
    JUST A 3D VIDEO, thats ground breaking.

    • @scrung
      @scrung 15 дней назад

      huh

  • @hootis1
    @hootis1 9 месяцев назад +986

    i love how short and to the point this video is, snappy editing and all

    • @editdev
      @editdev 9 месяцев назад +5

      big time. what a banger

    • @ac3d657
      @ac3d657 9 месяцев назад +1

      designed for zoomers that have low iq

    • @pan6593
      @pan6593 8 месяцев назад

      It‘s indeed quite brilliant in its making!

    • @immortalsun
      @immortalsun 7 месяцев назад +6

      bill wurtz!

    • @f.u.m.o.5669
      @f.u.m.o.5669 7 месяцев назад +4

      It's too quick for my brain to process.

  • @kindablessed4991
    @kindablessed4991 7 месяцев назад +92

    Anyone else think it was jerma in the thumbnail?

  • @PrivateCCC
    @PrivateCCC 9 месяцев назад +207

    "It's all open source" meaning that it will get actual development by people interested in the field and the various uses of the technology and not be strictly tied to development based around the agenda of corporations who mainly only develop new fields and block development further to maximize profits by having the minimum required to have it patented

    • @qiang2884
      @qiang2884 5 месяцев назад

      A bit late, but you probably never looked at the CS research community before. Nearly all student/professor papers comes with source code repo, and many corp research does as well. Go through a NeuroIPS archive and you can see hundreds of repos. Nearly all of the recent AI breakthroughs in the recent years are based on an OPEN paper published by someone in Google(the transformer paper), which ironically made google stress a lot now because they didn't get the opportunity to profit from their own invention before the other competitors.

    • @MacroAggressor
      @MacroAggressor 5 месяцев назад +17

      FOSS is the only way out of the impending dystopian technocracy hellscape. Change my mind.

    • @PrivateCCC
      @PrivateCCC 5 месяцев назад +2

      @@MacroAggressor agreed until they somehow make it illegal

    • @MacroAggressor
      @MacroAggressor 5 месяцев назад

      @@PrivateCCC I totally agree that the powers that be (and more importantly, their donors... Gates, Bezos, Google, etc) have a vested interest in undermining FOSS. As with most things, the best way to make it infeasible for them to steal a Right from the people, is for a critical mass of people to exercise that Right.

    • @finalcut612
      @finalcut612 5 месяцев назад +6

      @@MacroAggressor corporations routinely steal the labor of FOSS developers and exploit them all the time.

  • @wizarddude1917
    @wizarddude1917 9 месяцев назад +1146

    Loving the rapid improvement of tech and AI recently

    • @hactavis
      @hactavis 9 месяцев назад +29

      i believe next year will be very interesting

    • @SpringySpring04
      @SpringySpring04 8 месяцев назад +42

      Also love the rapid movement of this dude's video lol

    • @TheGreatResist
      @TheGreatResist 8 месяцев назад +10

      About one of the few things that still get me excited in the world we are living in.

    • @jojolafrite90
      @jojolafrite90 8 месяцев назад

      Oh, yeah, it's great that ONE A$$ hole can now drown RUclips with TENS OF THOUSANDS of videos all made by an AI, and make MILLIONS OF DOLARS in the process. Great for this already broken society. Great to have billions of videos in our medias that will keep us to see any real content. And nothing new will ever be made anymore.

    • @yuehan6711
      @yuehan6711 8 месяцев назад +61

      And the absolute stagnation of societal development means every bit of technology only sharpens the ridiculous irrationality of modernity and capitalism. If you were aware at all it should immensely worrying.

  • @aurisbunni
    @aurisbunni 2 месяца назад +6

    jerma took the edibles. again.

  • @micah371997
    @micah371997 9 месяцев назад +36

    Bro I work on planes for a living, I have no idea about what even you are talking about. I have superficial general knowledge, and have no reason to be here. Its like a swimmer accidently going to a calligraphy course and they are like "yea Ive written once" thats me. But I like watching your goofy and unique videos that explains concepts I never knew existed or mattered.

  • @Lolleka
    @Lolleka 7 месяцев назад +7

    This is truly amazing. And also very simple, I am surprised we are only seeing this now. Tech for small network has been mature for a while

  • @rustytvhead
    @rustytvhead 9 месяцев назад +10

    A minute of my time well spent on a subject I know nothing about, good video

  • @ZimoNitrome
    @ZimoNitrome 8 месяцев назад +4

    Wow super quick and condensed recap in a funny way. Nice

  • @1.4142
    @1.4142 9 месяцев назад +25

    Everything is a function

    • @OrangeC7
      @OrangeC7 9 месяцев назад +14

      They're a function, you're a function, I'm a function!

    • @youtubehandlesux
      @youtubehandlesux 8 месяцев назад +4

      Functional programming? More like unfunctional programming

    • @1.4142
      @1.4142 8 месяцев назад

      dysfunctional @@youtubehandlesux

    • @k_otey
      @k_otey 5 месяцев назад +2

      my life serves no function 😎😎🤯

    • @Wooly-chan-in6be
      @Wooly-chan-in6be 2 месяца назад

      in Category theory - Maxwell, probably

  • @AaronALAI
    @AaronALAI 9 месяцев назад +10

    Wow what an interesting time to be alive...gonna lurk in the discord.

  • @ShienlanMiitsues
    @ShienlanMiitsues 8 месяцев назад +12

    Bill Wurtz sends his compliments 🤣
    Jokes aside, this is exciting stuff!

  • @Wobr-J
    @Wobr-J 7 месяцев назад

    I LOVE YOUR CONTENT
    I love your fast paced comedic and informative approach to these things, 10/10 :)

  • @mulberry999
    @mulberry999 6 месяцев назад +8

    I really wish that this video was edited for an audience other than people with a fried attention span because it seems interesting.

    • @vlc-cosplayer
      @vlc-cosplayer 4 месяца назад +1

      If you got the attention span, you can do the research yourself 👀

  • @ultrio325
    @ultrio325 8 месяцев назад +3

    bro really just fit a whole essay into a minute

  • @chaseddraco
    @chaseddraco 2 месяца назад +2

    This feels so much like a Bill Wurtz video I love it

  • @ozzi9816
    @ozzi9816 8 месяцев назад +8

    A fun potential use for this would be a game where the landscapes and assets aren’t actual objects but props made by artists, kind of similar to how games like Hylics use claymation

  • @RenderingUser
    @RenderingUser 9 месяцев назад +44

    So basically, we already developed the software for holographic imagery before the hardware made it there?

    • @dibbidydoo4318
      @dibbidydoo4318 8 месяцев назад +13

      yes.

    • @realcoolguy123
      @realcoolguy123 8 месяцев назад +5

      technology!

    • @RenderingUser
      @RenderingUser 8 месяцев назад +1

      @@realcoolguy123 ruclips.net/video/Fc1P-AEaEp8/видео.html

    • @dsdy1205
      @dsdy1205 8 месяцев назад +13

      Ever since software existed it has outpaced hardware. Tbe first computer programs were entirely written out on paper before computers that could run them even existed

    • @RenderingUser
      @RenderingUser 8 месяцев назад +2

      @@dsdy1205 yes it always used to exist a level above. But this adds an additional dimension. That is certainly some progress
      I also find it epic how 2D photography existed before 2D rendering was a thing but 3D rendering was already a thing ages before 3D phototherapy became a thing

  • @DJ-Illuminate
    @DJ-Illuminate 9 месяцев назад +72

    Direct Mapping: Each splat directly corresponds to a point (or set of points) in the mesh. As the splat undergoes any transformation, the mesh point follows suit. If the splat moves to the left, the point moves to the left. If the splat grows in size, perhaps the point-mesh around that splat could expand or become denser.
    Fluidity in Motion: Imagine the splats as buoys floating on water. As they move, the net (or mesh) attached to them adjusts and moves with them. This creates a fluid, dynamic motion in the mesh that's directly influenced by the movement and behavior of the splats.
    Temporal Dynamics: If the splat data is changing over time (like in a sequence or animation), the point-mesh would continuously adjust and evolve frame by frame, creating a moving, dynamic representation.
    Overlapping and Merging: If two splats come close or overlap, the corresponding points in the mesh might also come closer, merge, or influence each other in some manner, depending on the design and algorithm in place.
    Interactivity: This approach also opens doors for interactivity. A user (like a designer or animator) could directly manipulate a splat and see real-time adjustments in the corresponding mesh, providing a tactile and intuitive way to shape and design 3D structures or animations.
    In essence, by directly linking the behavior of the splats to the motion and structure of a point-mesh, you can create a dynamic, responsive, and potentially more intuitive system for mesh generation and manipulation. It's a concept that harmoniously blends data representation with visual aesthetics and user interaction.

    • @braindancecollective
      @braindancecollective 8 месяцев назад +2

      You rock. Thank you for this!

    • @morgan0
      @morgan0 8 месяцев назад +9

      thanks chatgpt

    • @youtubehandlesux
      @youtubehandlesux 8 месяцев назад

      More botsplaining doesn't make this tech more impressive, you know. New developments in Global Illumination would be far more useful than this.

    • @Quell__
      @Quell__ 8 месяцев назад +1

      @@youtubehandlesux Well, be the change you want to see in the world

    • @lazerpie101
      @lazerpie101 7 месяцев назад

      I'm pretty sure this is just bones in current 3D rendering.

  • @forty000ne
    @forty000ne 2 месяца назад

    i'm in love with this video style

  • @justinpakarno4346
    @justinpakarno4346 9 месяцев назад +4

    The first Gaussian Splatting that I ever produced? You're drinking it, right now!

  • @Octocat
    @Octocat 8 месяцев назад

    It took 50 seconds to drop my jaw and make me think "holy cow."
    That's incredible! Can't wait to see what the future will bring!

  • @Astra2
    @Astra2 9 месяцев назад +167

    This tech is developing insanely fast! This feel like a major turning point in computer graphics, finally photo realistic graphics. Not almost photoreal, it's literally constructed from photos.

    • @lamsmiley1944
      @lamsmiley1944 8 месяцев назад +9

      It's the first tech that allows for realistic foliage in a 3D scene (in my opinion). I hope that someone finds a way to effectively use it in games.

    • @ondrej_hrdina
      @ondrej_hrdina 8 месяцев назад +4

      AFAIK this does not allow any kind of reflection, though. Anything other than rough, evenly lit surfaces won't change realistically depending on the point of view. Maybe there is a way to combine this method and traditional ones.

    • @lamsmiley1944
      @lamsmiley1944 8 месяцев назад +3

      @@ondrej_hrdina NERFs do allow for accurate reflections, but only of what was visible to the camera from the training data. Photogrammetry can't do reflections at all

    • @jojolafrite90
      @jojolafrite90 8 месяцев назад +10

      Until people can finally feel how lifeless all this is.

    • @giantisopod
      @giantisopod 8 месяцев назад +5

      Remember back in 2023 when we all thought this was sooo photo-realistic?

  • @weeferwafer2316
    @weeferwafer2316 8 месяцев назад +21

    Short and to the point!!! Thank you!! 💖

  • @demidrol5660
    @demidrol5660 8 месяцев назад +1

    Love this format!

  • @anotherone3340
    @anotherone3340 7 месяцев назад +51

    your narration is genius, it's non stop, has comic breaks and I loved that idea of using high pass filter to make a second voice. I don't even know what gaussian splatting is, i'm just watching for the fascinating presentation

    • @immortalsun
      @immortalsun 7 месяцев назад +13

      It’s inspired by bill wurtz. Still really cool

    • @polarartifact9863
      @polarartifact9863 6 месяцев назад +3

      If you think this is good you should watch "The History of the Entire World, I Guess" by Bill Wurtz. It's like this, but More.

    • @Infinatummedia
      @Infinatummedia 6 месяцев назад +1

      Gaussian is neat! So photogrammetry is the process of taking a giant chunk of images, throwing them into the AI and getting back a 3d object scan of it using dark ai sorcery. Problem is, actual 3d objects are complex, so you're trading size and performance for quality, and if you're just displaying something, its overkill. NeRF took that and made a process where it just makes a giant point cloud and fudges the details, and you get a photorealistic 3d environment with way less work. Unfortunately, it has to exist in its own little weird container to work. Gaussian splatting takes less processing to do the same thing, but can run in a nice lightweight container which is compatible with other things.

    • @SyenPie
      @SyenPie 5 месяцев назад

      Extremely well said, you managed to describe it perfectly. I began this video relaxed and amused thinking it was just another meme video, but I was physically tense in awe by the end. What a brilliant storyteller this man is.

  • @jennnital
    @jennnital 9 месяцев назад +3

    super cool! super curious to use these techniques in unreal

  • @BobRossCat
    @BobRossCat 8 месяцев назад +2

    Every second I watched this I feel like I’m learning something I regret knowing, but I can’t pause because I’m too curious about what’s next so it’s just a cycle until the video ends and I feel empty inside

  • @C_Corpze
    @C_Corpze 8 месяцев назад +1

    Damn, that looks really cool! Wonder if this will possibly also have use cases for video editing or some experimental art with motion blurs or glitch effects.

  • @devinspencer1678
    @devinspencer1678 18 дней назад

    Corridor's about to go hard with this

  • @rommix0
    @rommix0 Месяц назад

    now THAT is how you advertise an awesome piece of tech. I've recently became interested in 3D splatting and NeRFs.

  • @sungvin
    @sungvin 8 месяцев назад

    That’s my favourite kind of editing

  • @oskar4239
    @oskar4239 2 месяца назад

    I love the style of the video!

  • @ipaqmaster
    @ipaqmaster 5 месяцев назад +1

    This makes me feel like with enough 360 degree cameras for fidelity we can get 3d videos which can be paused, rewound and slowed down while also being able to move around in the 3d space and look at entirely different parts. Ideally as simply as recording a video with multiple perspectives.
    I can't seem to find it anymore but there was a recreation of some serious explosion for analysis years back extrapolated from all the footage and positions of each for the event. It feels like we can do that serious work but with just a few phones in a room with a click of a button and in minutes.

  • @logangarcia
    @logangarcia 9 месяцев назад

    love that 1 month of Quick change

  • @Rokutvvvvvvv
    @Rokutvvvvvvv 8 месяцев назад

    DAYUM THAT SOUNDS REALLY USEFULL

  • @samsanimationcorner3820
    @samsanimationcorner3820 8 месяцев назад +1

    Love the Bill Wurtz style.

    • @yancamb2202
      @yancamb2202 2 месяца назад

      Yeah, I was thinking of Bill Wurtz.

  • @gozearbus1584
    @gozearbus1584 8 месяцев назад +1

    great format, did not waste time and is clear

  • @Chleosl
    @Chleosl 6 месяцев назад

    This is the Vertor man.

  • @budstep7361
    @budstep7361 8 месяцев назад

    Thanks for the update! Very cool

  • @NolieRavioli
    @NolieRavioli 5 месяцев назад

    i like the trap ad libs grraa-ta-ta-ta

  • @dimakheilyk4079
    @dimakheilyk4079 8 месяцев назад +17

    What a cool video. 50 seconds and I know everything i needed about this! Love it, thanks🙏

    • @felix-dk9tr
      @felix-dk9tr 7 месяцев назад

      What is splatting, then?

  • @tylerwilliams33
    @tylerwilliams33 2 месяца назад +1

    *you could make a religion outta this*

  • @EpochEmerge
    @EpochEmerge 8 месяцев назад

    Finally we will be able to pick a pov for our taste

  • @Jakes_psyche
    @Jakes_psyche 7 месяцев назад

    I have a playlist called “cool stuff” this is definitely going in that playlist 😂

  • @someguy950
    @someguy950 2 месяца назад

    Yo that’s actually great for computer vision

  • @AlcharynMusic
    @AlcharynMusic 8 месяцев назад

    Scary, but really impressive algebruh

  • @randylin1871
    @randylin1871 8 месяцев назад

    well this fascinating stuff just went over my head haha

  • @MrMisterMaster
    @MrMisterMaster 8 месяцев назад +2

    This is how a Two Minute Papers and bill wurtz collab would look like

  • @marthinus.x
    @marthinus.x 9 месяцев назад +1

    temporal splatting. bring it on.

  • @Klaypy
    @Klaypy 5 месяцев назад

    I can already see those CSI scenes becoming an actual real thing😂

  • @stuart6478
    @stuart6478 7 месяцев назад

    incredible TWO DEE Gaussian splattering

  • @emmanuelagudo4918
    @emmanuelagudo4918 Месяц назад

    This technology would be the pinnacle of computing. We got to the point where we can make all our fantasies to life becoming closer to a 'perfect world', at least in VR.

  • @noslowerdna
    @noslowerdna 7 месяцев назад

    intriguiging!

  • @umeE-u
    @umeE-u 12 дней назад

    i have no idea what i just watched but i'm not complaining

  • @Estubu775
    @Estubu775 7 месяцев назад

    Super nice video!

  • @space_1073
    @space_1073 4 месяца назад

    Imagine how much further along humanity would be if every exciting new scientific paper were condensed into a 30 second clip anyone can understand / be intrigued by to learn more.

  • @CharlesLijt
    @CharlesLijt 8 месяцев назад

    My Apple Vision Pro need this technology!

  • @bobbsurname3140
    @bobbsurname3140 8 месяцев назад

    That rainbow pattern looks like something I created once while messing with color tiling. Where the RGB of a tiles neighbors was slightly different in some random way.

  • @loleq2137
    @loleq2137 8 месяцев назад

    Incomprehensible

  • @konstantinwilleke6292
    @konstantinwilleke6292 9 месяцев назад +1

    top level content. 10/10

  • @thedudely1
    @thedudely1 8 месяцев назад

    I appreciate the Bill Wurtz inspiration

  • @anastasiszaro
    @anastasiszaro 8 месяцев назад

    Dude just spawned dropped a one minute paper and yeeted.

  • @nonamenoname1942
    @nonamenoname1942 8 месяцев назад

    "No time to explain, Morty!"

  • @MMedic23
    @MMedic23 8 месяцев назад

    What I gathered from this is that, animated p*rn will now be much easier to create. Just lovely.

  • @The_mrbob
    @The_mrbob 8 месяцев назад +3

    I thought the thumbnail was Jerma…

  • @TrionerExpeliozias
    @TrionerExpeliozias 2 месяца назад

    this feels like one of those random Bill Wurtz videos that are really fucking fast

  • @Lord_Vertice
    @Lord_Vertice 8 месяцев назад

    i don't know who you are, or what you're talking about, but this video made me happy

  • @armoirestudio
    @armoirestudio 8 месяцев назад +1

    you deserver this sub

  • @deleted-test
    @deleted-test 8 месяцев назад

    this video reminded me of bill wurtzs editing style. pretty good stuff

  • @TommyLikeTom
    @TommyLikeTom 3 месяца назад

    it's basically the difference between keyframed animation and frame by frame animation, assume each frame is an entirely new scene or just a slightly edited version of the last scene

  • @GiusePooP
    @GiusePooP 8 месяцев назад

    Loki 2 spaghettification

  • @chazcheadle
    @chazcheadle 7 месяцев назад

    It makes me think of the video surveillance footage in the movie Star Trek; Into Darkness, where you can pan around the footage in realtime.

  • @DerTheoGD
    @DerTheoGD 7 месяцев назад +1

    nice editing

  • @Frorideism
    @Frorideism 8 месяцев назад +1

    Bruh my ADHD is vibing to this shit

  • @93hothead
    @93hothead 8 месяцев назад +2

    The hard part for this is getting training data without any good 360 cameras

  • @A_very_tinly_can
    @A_very_tinly_can Месяц назад

    This feels like a Bill Wurtz video

  • @vaccinoholik5562
    @vaccinoholik5562 8 месяцев назад

    imagine your doctor is making 3D model of your organs and check you inside using VR xDD

  • @lennybjorowitz4256
    @lennybjorowitz4256 7 месяцев назад

    someone reinvented bill wurtz.

  • @2tripp
    @2tripp 5 месяцев назад

    thumbnail looks like jermas evil sibling

  • @harrylane4
    @harrylane4 2 месяца назад

    "you've heard of gaussian splatting"
    me: uh huh totally i definitely have

  • @robokaos69
    @robokaos69 5 месяцев назад

    I thought the thumbnail was a jerma green screen clip
    the only reason I clicked on this
    not disappointed?

  • @CartyCreative
    @CartyCreative 8 месяцев назад

    This looks like with a little improvement it could be used in 3D camera tracking and 3D scanning from footage. Looks similar to a PositionToPoints node in Nuke from the data of a 3D render position pass

  • @boumex8842
    @boumex8842 5 месяцев назад

    that sounds amazing

  • @heckensteiner4713
    @heckensteiner4713 8 месяцев назад

    My gaussian just splatted all over the place!

  • @nitishupadhyay3972
    @nitishupadhyay3972 4 месяца назад

    I would love to be part of such discord groups where We're solving crazy ideas. Please add

  • @bernardvantonder7291
    @bernardvantonder7291 8 месяцев назад

    beautiful

  • @TheUnderscore_
    @TheUnderscore_ 7 месяцев назад

    history of tech, i guess

  • @ilanlee3025
    @ilanlee3025 8 месяцев назад

    Amazing subscribed

  • @potatosantitizer5901
    @potatosantitizer5901 2 месяца назад

    This video feel like adhd when muted

  • @Douken
    @Douken 8 месяцев назад

    I need a longer video

  • @silvertakana3932
    @silvertakana3932 9 месяцев назад +4

    this is lit

  • @gianluca1424
    @gianluca1424 8 месяцев назад

    What would the camera setup be to make this 4d Gaussian splating like a reverse 360 camera pointed at you?

  • @rsybing
    @rsybing 7 месяцев назад +3

    The way this video is formatted is an excellent example of why it's more useful to write out important ideas in prose

    • @garshtoshteles
      @garshtoshteles 6 месяцев назад +1

      I'm not sure I understand the distinction you're drawing. As opposed to what, writing important ideas in poetry?

    • @Randarrradara
      @Randarrradara 5 месяцев назад

      yeah. poetry is for cringe essays on youtube @@garshtoshteles

  • @miguelperfume4212
    @miguelperfume4212 8 месяцев назад

    this editing gives me bill wurtz vibes

  • @matthewromig8748
    @matthewromig8748 7 месяцев назад

    I want the VR capability that this could provide more than anything