Unreal Engine 4 (compositing with real footage)

Поделиться
HTML-код
  • Опубликовано: 28 сен 2021
  • This was the first time we used Ue4 in compositing with real footage. I was surprised that Unreal Engine rendered frames faster than After Effects)). Yes, this is definitely the future!
    #unrealengine #unrealengine4 #rtx #vfx #cg #aftereffects #compositing #makingof #cameratracking
  • КиноКино

Комментарии • 764

  • @leokimvideo
    @leokimvideo 2 года назад +1824

    This is scary and mind blowing. So many traditional film industry jobs will vanish in an instant when this is used all the time.

    • @_Hadda
      @_Hadda 2 года назад +122

      Just like the matte painters of the past, gotta brush up that resume....well until that new job gets replaced by UE.

    • @Tensaroxx
      @Tensaroxx 2 года назад +134

      even this is getting replaced by quantum led screen like they used in Madalorian

    • @robertYoutub
      @robertYoutub 2 года назад +177

      Not at all. Thats still a lot of work, for highly experienced people, Why should any one stop working, because he has a new tool?

    • @leokimvideo
      @leokimvideo 2 года назад +13

      @@robertYoutub Sadly you don't understand how this would be done without all the 'fake' images going on here.

    • @robertYoutub
      @robertYoutub 2 года назад +84

      @@leokimvideo Well, he explained how he did it. And beside the 3d environment based on the free scanned stuff in Unreal made him use it. Without the huge libraries and assets, Unreal is a different thing. Not sure what you mean with fake images so. The whole spot could be done in any 3d software with the same workflow and amount of work, only that it was easier with Unreal in certain way. The true advantage in 3D now, is that we can get a huge amount of well done assets, making it easier to build such scenes and more realistic. But, its not that Unreal is less work, then any other 3d app.

  • @justshady
    @justshady 2 года назад +508

    Anything renderers faster than After Effects at this point.

    • @lichendigital
      @lichendigital 2 года назад +16

      Major burn 🤣

    • @Stef-an
      @Stef-an 2 года назад +23

      Yeah lol, DaVinci Resolve is a GOD of rendering times compared to AE :D

    • @junechevalier
      @junechevalier 2 года назад +7

      Ae is a relic of olden times

    • @elpapados
      @elpapados 2 года назад

      @@junechevalier jajaja

    • @rxflexedits3310
      @rxflexedits3310 2 года назад

      new. update?

  • @ChristianIce
    @ChristianIce 2 года назад +1287

    The bottom part is cool, the top one is full of green walls, very ugly.

  • @sergeygilgenberg8331
    @sergeygilgenberg8331  2 года назад +530

    Hello everybody! In the comments, many ask to write about the workflow. In this work, the workflow is short as follows. Sorry for my english!) Based on the references, we created locations in Ue4. Then we animatic the camera movement, which allowed us to see how the finished video would look like. Then we started filming the actors in the green studio, placed markers on the walls and recorded their distance from each other. Took the information about the lens distortion. We put all the light on the actors the same as was done in advance in Ue4. We shot on Red epic with DJI ronin in 5K maximum quality. In post-production, the shots were edited with all the actors' lines and music. Camera tracing in 3d Equalizer soft, after which the data was imported into Ue4 via Cinema 4d (Ue4 does not understand the 3d Equalizer format, so we did the Datasmit project in C4d). The render in Ue4 was with Ray tracing enabled. (On average, 1 scene 1 hour 30 min render in 3k on rtx 2080ti). Fog and foreground were rendered separately with an alpha channel). In after Effects I removed the distortion of the lens (3d Equalizer preset). Removing the noise ( Neat video plug) then chroma key was made standard ( Key light, Refine soft matte plugins) and light wrap effect with RGB correction of graphics and video images. Then I returned the lens distortion and noise. Finally, color correction Lumetari color plug. it seems everything)

    • @Jim5988
      @Jim5988 2 года назад +10

      wow thanks for the insight mate, that‘s ever so helpful and much appreciated! cheers!

    • @MrBetyko
      @MrBetyko 2 года назад +1

      amazing work !

    • @MrBetyko
      @MrBetyko 2 года назад +3

      But with all those step , is the total time of post prod was bigger then just doit all in after effect (not rendering but whole process)?

    • @jeeteshgoyal1474
      @jeeteshgoyal1474 2 года назад

      Thanks buddy

    • @VuPhamRainstorm
      @VuPhamRainstorm 2 года назад +3

      you are so kind to share your glory video technique. How long did you finish this work ?

  • @AllThingsFilm1
    @AllThingsFilm1 2 года назад +466

    Boy, what I would do for tutorials on creating these UE worlds and compositing. Excellent work.

    • @abdullaal-naimi9075
      @abdullaal-naimi9075 2 года назад +60

      You're wrote this comment on one of the largest repositories of human knowledge to ever exist. You're literally a search away from learning UE and waaaaaay more.

    • @yusrighouse
      @yusrighouse 2 года назад +12

      Boy do I have the video series for you: ruclips.net/video/gQmiqmxJMtA/видео.html

    • @carso1500
      @carso1500 2 года назад +3

      @@abdullaal-naimi9075 one of it not the largest, after all both RUclips and Google are connected making it the biggest lovrsry in human history

    • @Qotroz
      @Qotroz 2 года назад +3

      These renderings are not really considered professional by people in the industry. But yes, they are impressive to people who are new to CGI.

    • @danielguedes1559
      @danielguedes1559 2 года назад +2

      @@Qotroz WTF?!

  • @christopherdiaz893
    @christopherdiaz893 2 года назад +234

    I'm surprised at how clean these keys look!! Really nice work.

    • @zdenekburian1366
      @zdenekburian1366 2 года назад +2

      yes but laws should be enforced to forbid this type of visual scam from advertising implementations

    • @alexiedecoplus1018
      @alexiedecoplus1018 2 года назад +13

      @@zdenekburian1366 what scam?

    • @kickassmovies5952
      @kickassmovies5952 2 года назад +1

      how can the key be so clean, especially near hair-head region in realtime.

    • @Samirxkhan
      @Samirxkhan 2 года назад +13

      @@zdenekburian1366 did you really just call film making a visual scam? Lmao

    • @zdenekburian1366
      @zdenekburian1366 2 года назад +1

      @@Samirxkhan no, I said for advertising use, the watcher is engaged inside a virtual world which is ok in fiction etc but instead subliminally induces false qualities to goods and services

  • @ecs-p3196
    @ecs-p3196 2 года назад +14

    absolutely incredible, this is such inspiring work! also your music is next level

  • @TheTanelChannel
    @TheTanelChannel 2 года назад +4

    Awesome job Sergey!!!
    Glad to see people making it their mission to push boundries.
    Keep up the great work

  • @denu1879
    @denu1879 2 года назад +134

    I was under the impression that this was done in Nuke compositing with 3D frames exported from Unreal. I didn't actually realise this was composited all inside Unreal Engine 4, that's just incredible! Shows its ahead of everyone else!

    • @wnazgul
      @wnazgul 2 года назад +3

      By seeing this, it doesnt proof it comes even close to nuke compositing. It is very easy to show this footage is such low resolution so you cant see the mistakes on the edges. Also it is very easy to show some cool comp if you are the only one that decides that should be done with it. If you count in some cient feedbacks and extra stuff that needs to be done. You will use U4 to show quick work but eventually you will do everything in nuke.

    • @AlexFord-gp7by
      @AlexFord-gp7by 2 года назад +6

      @@wnazgul but this is real time 3d you don't have to wait till the 3d program exports each frame

    • @Mtojay
      @Mtojay 2 года назад +4

      but it wasnt composited in ue? op states taht he tracked in 3d equalizer and keyed and comped in ae or am i missing something?! they are tracking stuff in external tool, building the world and rendering in ue and then comping in ae or tool of choice. its a classic approach to filmmaking only using ue4 for rendering adn not a classic 3d package

  • @yaelm631
    @yaelm631 2 года назад

    One of the best video to demonstrate what virtual production is !

  • @RH3D
    @RH3D 2 года назад +3

    Matchmove artist here - give whoever dressed that set a raise. Pretty sure theyre the only person on earth putting that many tracking markers on

  • @superjarri
    @superjarri 2 года назад +57

    Next step is replacing human beings by virtual characters and then voices by synth voices. The technology is getting there.

    • @jhnyjoejoe69
      @jhnyjoejoe69 2 года назад +4

      Vocaloids. Licensed voice and likness from actors.

    • @zemrpereira
      @zemrpereira 2 года назад +8

      that already happens in China. Virtual news anchor...I guess it's easier for a cartoon to lie with a straight face.

    • @houstonhelicoptertours1006
      @houstonhelicoptertours1006 2 года назад +1

      "Yeah, fuck humans! We're peddling products and services to humans...but fuck humans, they kinda suck!"

  • @isaacait.6679
    @isaacait.6679 2 года назад

    I almost hit the like button the second time!!! 😂 that’s really unreal and terrific

  • @MartynDerg
    @MartynDerg 2 года назад +1

    I lost count of how many times I yelled "WHAT" while watching this, this is absolutely incredible work

  • @coab43a22f2
    @coab43a22f2 2 года назад +1

    Very good work, A+ quality

  • @hameez1channel604
    @hameez1channel604 2 года назад

    Looking amazing! Beautiful 🥰

  • @humandarion
    @humandarion 2 года назад +1

    Astounding work

  • @blazerayYT
    @blazerayYT 2 года назад +1

    Here before a million views, this is a really cool video

  • @technoar8161
    @technoar8161 2 года назад +1

    Brutal!!!! Mis respetos bro

  • @VRDivision
    @VRDivision 2 года назад +1

    Great work!

  • @user-ct8my8rv9c
    @user-ct8my8rv9c 2 года назад

    Really impressive, good work

  • @pechytoloco
    @pechytoloco 2 года назад +1

    Gaming industry is going to have to get way more actors for the games, really cool

  • @MoviesRemastered
    @MoviesRemastered 2 года назад

    This is extremely awesome.

  • @zenbauhaus1345
    @zenbauhaus1345 2 года назад

    amazing work

  • @TheSolfilm
    @TheSolfilm 2 года назад

    Gorgeous !

  • @gabyfly9756
    @gabyfly9756 2 года назад

    Great Job! i LIKE IT

  • @TrollogyExpert
    @TrollogyExpert 2 года назад +4

    I cant remember the name of the danish movie director that a few years ago was talking about the coming "democratization of movie making", but I think technology like this is going to create a whole new area of possibilities including real-life streaming content that we can't even imagine at the moment.
    Unreal Engine 4 is absolutely amazing.

    • @bien.mp4
      @bien.mp4 2 года назад

      so true. Decentralized media is a real phenomenon and it's growing fast.

  • @smepable
    @smepable 2 года назад +1

    Amazing mirror reflections of the people in the Windows.

  • @mustardseed
    @mustardseed 2 года назад

    Very nice work!

  • @user-qb5tg6eg2e
    @user-qb5tg6eg2e 2 года назад

    This is AMAZING!

  •  2 года назад

    One word: Magic!

  • @SaadKidwai
    @SaadKidwai 2 года назад

    Incredible

  • @WangleLine
    @WangleLine 2 года назад +1

    That's really cool

  • @PIXELvoiz
    @PIXELvoiz 2 года назад +1

    I have seen many green screen footages before but this video has epic music felt like future is here

  • @Stef-an
    @Stef-an 2 года назад +1

    Awesome work! This might even replace Nuke in future

  • @MissingNumber
    @MissingNumber 2 года назад

    The music makes it so much more awesome

  • @SiLiDNB
    @SiLiDNB 2 года назад

    AMAZING

  • @qui573
    @qui573 2 года назад

    This is insane!

  • @romanbruni
    @romanbruni 2 года назад +1

    really yes... congrats it is nice ! cheers from Rio

  • @KONFLIK2175
    @KONFLIK2175 10 месяцев назад

    dude this is radical!

  • @user-ym2ne1zg1b
    @user-ym2ne1zg1b 2 года назад +1

    Очень круто! Вы - настоящие профессионалы!

  • @zombne
    @zombne 2 года назад

    This is actually insane

  • @wispaschannel
    @wispaschannel 2 года назад

    Awesome

  • @vanyakapetanovic4018
    @vanyakapetanovic4018 Год назад +2

    This proves that green screen is still the king.

  • @SeniorAdrian
    @SeniorAdrian 2 года назад

    Amazing.

  • @alien31ita
    @alien31ita 2 года назад

    not only the engine doesn't exist,
    your reality too, amazing.

  • @MMaRsu
    @MMaRsu 2 года назад

    Wow, mind blown. I need to get in on UE4

  • @KillerTacos54
    @KillerTacos54 2 года назад

    That looks, pardon me, UNREAL!

  • @EduardRitok
    @EduardRitok 2 года назад

    that last cgi was nuts ❤️

  • @coldirty
    @coldirty 2 года назад

    really cool

  • @CrazyKyogre
    @CrazyKyogre 2 года назад +1

    encredible

  • @sarcasticstrange
    @sarcasticstrange 2 года назад

    Damn! This is
    UNREAL!!!

  • @stereosteyn
    @stereosteyn Год назад +1

    excellent

  • @Nosttromo
    @Nosttromo 2 года назад +6

    "I was surprised that Unreal Engine rendered frames faster than After Effects"
    yeah, it's almost like it's a game engine designed to render 3d objects in real time

  • @CameraAdventure
    @CameraAdventure 2 года назад

    Very nice 👌

  • @Zatra
    @Zatra 2 года назад

    Wow :o

  • @babarchaudhary6979
    @babarchaudhary6979 2 года назад

    Amazing work dear

  • @UedersonThec
    @UedersonThec 2 года назад

    Wow! This is something you can't say is unreal (I mean the normal screens) until you see the green background. One of the good things (in my point of view) is how easy people like me can make beautiful videos without special tools.

  • @shahsahab6796
    @shahsahab6796 2 года назад

    Perfect brother

  • @thundageon5962
    @thundageon5962 2 года назад +14

    We went from two rectangles duking it out in ping pong to a full-fledged interactive playable movie.

  • @la-ia1404
    @la-ia1404 2 года назад

    Looks so unreal.

  • @elry6030
    @elry6030 2 года назад

    if they can use this on a live broadcast on TV, it would be amazing. I still remember when our local TV introduced Hologram technology

  • @daniiltuneev3123
    @daniiltuneev3123 2 года назад

    that's sick

  • @Jsfilmz
    @Jsfilmz 2 года назад +4

    Great JOB! Were these recorded on an external recorder? Or were they rendered in the engine? Im working on my Virtual production course here shortly trying to see what people are interested more in

  • @ninjapants7688
    @ninjapants7688 2 года назад +4

    Needs to be run through Nuke/Davinci to get the colour grading correct, fix the green in the chromakey, match the tones correctly and adjust the levels. I still see the people as being brighter/over the top of the composite.

  • @dietrichdietrich7763
    @dietrichdietrich7763 Год назад +1

    Amazing 3D

  • @RaffoVFX
    @RaffoVFX 2 года назад +8

    stunning work! Im still asking myself why Im not using unreal engine.
    Its astonishing to see that all of a sudden some softwares comes out of nowhere placing themself as a gamechange, like Unreal or Embergen

    • @oksowhat
      @oksowhat 2 года назад

      what the use of this?

    • @aaron4820
      @aaron4820 2 года назад +3

      ... I wouldn't exactly say Unreal came out of nowhere lol

  • @j0hNy0u
    @j0hNy0u 2 года назад

    we neeeed a tutorial of the whole workflow asap this is amazing

  • @StephanBuchin
    @StephanBuchin 2 года назад

    Definitely sets the standard.

  • @MICHAEL_GOLDMAN
    @MICHAEL_GOLDMAN 2 года назад +1

    This is what Neo was talking about.

  • @Morso.mertal
    @Morso.mertal 2 года назад

    i love it

  • @MactGamer
    @MactGamer 2 года назад +1

    Nice

  • @abc369
    @abc369 2 года назад

    Кругом сплошное наживалово.
    Красиво очень. Контраст "живой картинки" и оригинальной огромен.

  • @arnoldwinford1096
    @arnoldwinford1096 2 года назад

    That Great !!

  • @rucchi7
    @rucchi7 2 года назад

    Good job!

  • @bobbyjonas2323
    @bobbyjonas2323 2 года назад

    Cool

  • @HumoristUnion
    @HumoristUnion 2 года назад +1

    Эхх, родной Краснодар

  • @hitcom6258
    @hitcom6258 2 года назад

    Very cool! The next challenge is glass objects, water, and hair that isn't glued to the head.

  • @JuanJC3D
    @JuanJC3D 2 года назад +1

    holy crap wow! Not sure what or who's more impressive, the software engineers or the artists!

    • @csmemarketing
      @csmemarketing 2 года назад

      Always the artists, but Unreal Engine makes it easier and faster. Unreal if fully supporting the Movie VFX and Architectural Visualization Industry now.

    • @JuanJC3D
      @JuanJC3D 2 года назад +1

      @@csmemarketing Yes, but, the software itself is a piece of art (and science). So I think both!

    • @JuanJC3D
      @JuanJC3D 2 года назад

      --the software engineers* and artists, I should clarify

    • @houstonhelicoptertours1006
      @houstonhelicoptertours1006 2 года назад

      Computers & software do nothing on their own. They are tools.
      Also, don't bother if you're not an artist, software can't compensate for that. Never will.

    • @JuanJC3D
      @JuanJC3D 2 года назад

      @@houstonhelicoptertours1006 --the software engineers* and artists, I should have clarified. To make such tool there is a huge amount of time, knowledge, experimentation, science, and even art/creativity. Without them engineers, there's be no software capable of achieving this. And without artists, the software can't reach such potential.

  • @Mono_Autophobic
    @Mono_Autophobic 2 года назад +2

    Games with that graphics would break the wall of gaming and reality

  • @AsenAierVlogs
    @AsenAierVlogs 2 года назад

    It's mind blowing ! Btw back to basic ..which hardware do use to run unreal software ? Any specific configuration ?

  • @Firebear31
    @Firebear31 2 года назад

    lol why do i even continue to use AE - that's super neat. thanks for the vid, looks awesome.

  • @justamanofculture12
    @justamanofculture12 2 года назад +1

    We want a UE5 version now . Heard great things.

  • @Originalimoc
    @Originalimoc 2 года назад

    Mind boggling

  • @salientfilm
    @salientfilm 2 года назад

    nice!

  • @bryanbarajasBB
    @bryanbarajasBB 2 года назад

    Yeah, I've been thinking about this and here it is.

  • @jacks19822
    @jacks19822 2 года назад +3

    Amazing, can I ask how much did it cost for your client to get this all done? 100K+ (USD) ?

  • @steveschmitt6933
    @steveschmitt6933 2 года назад

    I love technology like this

  • @AFiB1999
    @AFiB1999 2 года назад

    HOW? Amazing tecnology

  • @geack
    @geack 2 года назад

    This is unreal!!!

  • @niknikk8827
    @niknikk8827 2 года назад

    очень круто))!

  • @koolerpure
    @koolerpure 2 года назад

    imagine video game cutscenes being like that although id think it would look even better in unreal engine 5

  • @mariorodriguez8627
    @mariorodriguez8627 2 года назад +5

    great work do you have a tutorial?

  • @EdwardYusupov
    @EdwardYusupov 2 года назад

    Оч круто!

  • @startedtech
    @startedtech 2 года назад

    Looks pretty great! Though the papers flying look kinda strange and very videogamey.

  • @solar-monk
    @solar-monk 2 года назад +3

    Wow. Breathtaking work. Are you guys planning to do any tutorials on these?

  • @rakibiqbal9759
    @rakibiqbal9759 2 года назад

    man thats unreal!!!!!!!

  • @codyshann
    @codyshann 2 года назад +2

    This is very impressive for the 'Unreal Engine'. Wait till you see how the 'Real Engine' works.

  • @zielaz3714
    @zielaz3714 2 года назад +2

    Incredible... without the screen showing the REAL footage, I would have thought that they were really in an office. Then again, the desert area definitely has realism but can be easily determined as fake. It's not the graphics, it's the situation and logical reasoning could prove that this was... well... unreasonable.

  • @philipvideoproductions9007
    @philipvideoproductions9007 2 года назад +2

    Wow! How did you camera track? Did you just use the tracking points in the green screen or did you use a camera tracking system? :)

    • @GhostStealth590
      @GhostStealth590 Год назад

      For most of the RAW shots we see, we can see little green stickers, particularly tracking markers. General rule is to keep one stop above or below the lumens of the greenscreen, no more or less though as that makes your keying that much more difficult. For shots that don't have tracking markers, I'd guess they used a camera tracker and babysat the tracking process in case the 3D tracker goes AWOL.