Samsung’s AI: Megapixel DeepFakes! 📷

Поделиться
HTML-код
  • Опубликовано: 18 сен 2024
  • ❤️ Check out Lambda here and sign up for their GPU Cloud: lambdalabs.com...
    📝 The paper "MegaPortraits: One-shot Megapixel Neural Head Avatars" is available here:
    samsunglabs.gi...
    ❤️ Watch these videos in early access on our Patreon page or join us here on RUclips:
    - / twominutepapers
    - / @twominutepapers
    🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
    Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bryan Learn, B Shang, Christian Ahlin, Eric Martel, Geronimo Moralez, Gordon Child, Ivo Galic, Jace O'Brien, Jack Lukic, John Le, Jonas, Jonathan, Kenneth Davis, Klaus Busse, Kyle Davis, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Michael Albrecht, Michael Tedder, Nevin Spoljaric, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Steef, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
    If you wish to appear here or pick up other perks, click here: / twominutepapers
    Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
    Károly Zsolnai-Fehér's links:
    Instagram: / twominutepapers
    Twitter: / twominutepapers
    Web: cg.tuwien.ac.a...
    #DeepFake

Комментарии • 569

  • @Mutual_Information
    @Mutual_Information 2 года назад +342

    Whoa this is wildly good.. and I didn’t even realize Samsung did excellent AI research

    • @gfhfhgfhfgh1562
      @gfhfhgfhfgh1562 2 года назад +15

      Samsung basically owns SK along with the other 3 big families, they're great at both dodging the laws and dabbling in every single tech field

    • @StrangerHappened
      @StrangerHappened 2 года назад

      The actual research is made by the Russians. I wonder how things will go with sanctions and everything, whether Samsung's funding will stop and they will be funded by someone else or not.

    • @LastSliceOfPie77
      @LastSliceOfPie77 2 года назад

      samsung is 20% of South Korea's economy.

    • @TotallyFriedChannel
      @TotallyFriedChannel 2 года назад +10

      If you wanna stay relevant you have to do AI research :shrug:

    • @kailashchandraninamakailas4318
      @kailashchandraninamakailas4318 2 года назад

      @@mnomadvfx loooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo ऊपूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूूपप्प

  • @nedlanduzuln9867
    @nedlanduzuln9867 2 года назад +177

    Those are great results! To answer your question about what actors I would like to see revived: none, as we should rather look for new talents from younger generations. These legends have already left a great legacy behind in my opinion.
    The potential is still mind-blowing, though!

    • @markfeeer2149
      @markfeeer2149 2 года назад +11

      Just the looks does not review those people I would only use it for continuity reasons.

    • @scheuerman
      @scheuerman 2 года назад +1

      This technology will replace actors completely. There will not be "younger generations" unless you are counting the research papers based on these techniques.

    • @PRiMETECHAU
      @PRiMETECHAU 2 года назад +1

      Allot of actors also loose enthusiasm for acting as they get older, sometimes brought on by illness of cause.
      Aging sucks, doesn't benefit anyone for the whole world to get old and unable to function _well_ for a good portion of their lifespan... just my 2 cents.

    • @codinghusky5196
      @codinghusky5196 2 года назад +4

      @@markfeeer2149 there ARE no continuity reasons. whatsoever.
      A character being re-cast by a new actor is nothing new, nothing unseen, and has always been well tolerated by audiences. Take James Bond or Batman or Superman or Billy the Kid or... who ever, until Disney decided we were too stupid to understand it's a MOVIE and characters get re-cast.
      And no, aging doesn't benefit............... anyone; except... you know, the young people. Who get jobs after the older actors get older. Like, imagine if Arnold, van Damme, Bolo Yeung, Sigourney Weaver, Dolph Lundgren, Sly Stallone... were still as they were in their 30ies; would Chris Hemsworth, Chris Pratt, John Cena, Charlise Theron... ever gotten a chance? If these current actors become easily and cheaply replicated, are we just going to continue to have 57 new movies with CGI replicated Hemsworth Thor and no actor even having hope to get into that role, and in turn the role never having hope to be freshened up and renewed?
      ( Like imagine all the Batmans and James Bonds' we had in the past decades. Yes, but every new actor brought something new different and interesting to the role. Imagine if all the movies were just made by replicating Lewis G. Wilson's or Sean Connery's performance. Would we have missed out? In a word: YES. )
      What I'm saying is, life has to happen. We shouldn't stop aging and dying because then we'll stop developing and growing as a species. I'm not enthusiastic to age or die; but I can say with 100% certainty that, should I have lived for 400 years, I would have changed, developed and DONE less than 5 different people replacing "me" in order during those 400 years,each continuing roughly where the last one stopped. New replacing the old is a STRENGTH, not a Pitfall.

    • @nedlanduzuln9867
      @nedlanduzuln9867 2 года назад +1

      @@scheuerman This could very well be the case in the long run. However, at least in the short-medium term, I think both actors and deepfakes will be used, a bit like today's movies using mixes of CGI and practical effects.

  • @krasen671
    @krasen671 2 года назад +98

    you know when he says "Wwwhat a time to be alive!" it is truly groundbreaking

  • @epiczeven6378
    @epiczeven6378 2 года назад +89

    The fact that its source is a 2d image, and it´s a real-time deepfake is impressive.
    A realistic fully digitize 3d models of our face and the reference would be the next level (real-time aswel)
    And who knows, maybe one day we will fully digitize each individual 100k hair :D

    • @thomasgoodwin2648
      @thomasgoodwin2648 2 года назад +5

      Complete with a database collected from say .. YT of any and all persons, characters, monsters, and anything else that can be remotely anthropomorphized for instant use in zoom meetings and beyond.
      Now where's my Torgo costume?

    • @lubbyLB
      @lubbyLB 2 года назад +1

      nvidia is going to add head and hair reconstruction to audio2face

    • @fabricejaouen378
      @fabricejaouen378 2 года назад +4

      what would be the point digitizing 100k hair when you can simulate them ? none

    • @epiczeven6378
      @epiczeven6378 2 года назад +1

      @@fabricejaouen378 lol true, but it would be nice to simulate the physics to the 100k level 😃

  • @felipereigosa96
    @felipereigosa96 2 года назад +114

    This is awesome, I particularly like the "live painting" at 2:46. I would use this result to put a screen on my wall disguised as a picture frame but with a live subject like on hogwarts! Also imagine the possibilities, if a show gets cancelled too soon (cough cough firefly), we can hire new people to write a new script (or use gpt-3 to do it for us!) and then shoot the new episodes with the actors looking as old as they were then.

    • @avidrucker
      @avidrucker 2 года назад +11

      +1 To a virtual Firefly continuation! 😁😁😁

    • @Drokkstar_
      @Drokkstar_ 2 года назад +7

      I was saying this to my colleagues! There are so many satisfying ways to use it. Finishing dead projects, replacing awful casting choices, and giving people cathartic closure for 'what ifs': we can finally see Cage as Superman!

    • @RamKaran-ri4sc
      @RamKaran-ri4sc 2 года назад

      @@avidrucker sweet dork asset dirk6

    • @larion2336
      @larion2336 2 года назад

      That's a great suggestion. Someone needs to make me another ten seasons of Stargate ASAP.
      And then on the other hand, you could probably deepfake a fictional character to get better casting for a fantasy or sci-fi show as well. Though, *cough* simply casting the right ethnicity character these days would be a major improvement over anything woke hollywood does now.

    • @mantridsos6277
      @mantridsos6277 2 года назад +2

      I think in a decade or so we'll be able to feed firefly fanfiction into a general purpose AI and get multiple screenplays out of the other side, have them critiqued, iterated upon and have the best one picked, multiple storyboard artist and director algorithms interviewed and the best ones for the job recruited, the same with the other tasks, and get a full movie as the output.

  • @BigMTBrain
    @BigMTBrain 2 года назад +38

    When I first started an AI and Robotics meetup years ago, one of my first expressed desires and predictions: the creation of Synthetic Prince. First in virtual form, then in robotic form. Secondly, to have all episodes of Star Trek: The Original Series re-done in VR, where all of the environments and people off-camera are inferred along with the on-camera elements, allowing anyone to BE THERE and experience everything as if an invisible member of the crew. A future version would go beyond observation to allowing you to be a new crew member that evokes new real-time interactions, which means all of the character personalities will need to be inferred. Outlandish today; reality tomorrow.

    • @Plafintarr
      @Plafintarr 2 года назад +2

      The Synthetic Lifeform Formerly Known As Prince!

    • @jessiejanson1528
      @jessiejanson1528 2 года назад +4

      What would be really interesting is to train an AI based on a characters interactions so the AI then makes the same decisions given the same situation. if you do this for every character, you could then throw them in a new situation and essentially you could create new content. though this would likely only work for well defined characters which are not that common these days. lots of "because plot" for the reasons characters do what they do. i look forward to the day when AI can make movies based on our own scripts. i think we will see a massive increase in quality content and all these hack writers and directors can finally be thrown away.

    • @BigMTBrain
      @BigMTBrain 2 года назад +2

      @@jessiejanson1528 Great thoughts, and this is precisely what I meant when writing "...that evokes new real-time interactions, which means all of the character personalities will need to be inferred." "Inferred" = output from an AI trained to do so.

    • @TheBeatle49
      @TheBeatle49 2 года назад

      The Holodeck cometh!

  • @Thepher6
    @Thepher6 2 года назад +25

    From these paintings it understands the light source and it generates correct shadows for the movements. The catch light on the eyes is also moving like it should but maybe not perfectly. Anyway, it's a testament to the AI and the painters too.
    I can already see a business for bringing to life deceased friends and family from old photos
    Future gets cooler and weirder with every step

    • @Weston29406
      @Weston29406 2 года назад

      I can't wait until they are able to recreate old TV shows. Are you ready for season 9 of That '70s Show?

  • @C.I...
    @C.I... 2 года назад +91

    This genuinely scares me. Now, if enough audio/video of a given person exists, evidence can easily be fabricated to discredit them or to ruin their lives. Detection will only get worse, as adversarial training is a big part of how these models work.

    • @ilikenicethings
      @ilikenicethings 2 года назад +13

      Yes but how could it ruin someone’s life if enough people know how easy it is to fake? Video evidence would become untrustworthy generally. But I guess in some countries especially it would be worse than others

    • @Sashazur
      @Sashazur 2 года назад +28

      @@ilikenicethings Also even in places where deep fakes are known, the technology is still not super widely known. A fake video could still get a lot of traction before debunkers jump on it, and of course there will always be people who’ll believe it no matter what, because it supports their views.

    • @shauna996
      @shauna996 2 года назад +9

      Teaching about fire this technology can be misused is what the author of these videos is doing. He seeks out government authorities to teach them before a major misuse occurs.

    • @Graphomite
      @Graphomite 2 года назад +1

      We're entering a reality where nothing on a screen will be trustworthy, which will create a double-edged sword:
      On one hand, normalizing the concept that the internet is no longer just biased and unreliable, but predominated by objectively fictitious imagery, will demand that the general populace will need to stop relying on social media for information, lest they be ostracized with the willful ignorance equivalent to a flat-Earther. This is assuming all of our brains aren't _complete_ porridge by the time deepfakes become indistinguishable and accessible. It's always possible ten years from now, we're brainwashed to the point of being incapable of not believing our monitors no matter *what,* but if that's the case, slanderous deepfakes are probably ineffective to the big picture.
      On the other hand, this would also make a lot of _important info_ moot. Security footage will have to be considers invalid in the court of law. But I suppose overall that would not matter very much, given recordings will inevitably be outclassed by AI powered security/investigation, anyway?
      I'm more concerned with subjective matters. There's always going to be black and white evidence somewhere. We aren't going to incarcerate Obama for a deepfake of him saying _"I assisted Epstein."_ What frightens me is how things like deepfakes and generative AI will taint integrity and values, and thus critical thought, in general. Even sticking to the topic of deepfakes something as simple as actors no longer y'know...acting, and receiving royalties on their likenesses, creates a really out of touch circumstance, and that's a pretty tame example. Apply that automation to everything (including art!), and a utopian society looks more like a Brave New World situation of people not giving AF about anything.

    • @larion2336
      @larion2336 2 года назад +6

      @@Sashazur As with most things what we need in response is more education / critical thinking to counter-act the negative social effects. Otherwise I'm not sure what point there is to people complaining about how this tech may be misused. There is no putting the genie back in the box.

  • @rytan4516
    @rytan4516 2 года назад +13

    Oh, I recognise these artefacts! This happens when the AI gets fixated on the screen-position of fine details. When the actor moves, and the deepfake video moves, the hair stays on the same place on the deepfake, while the hair moves relative to the head. This problem is already addressed in another paper, which used an AI to create local coordinate systems for the faces, so using the two techniques together might be an easy way to fix this problem.

  • @Qsie
    @Qsie 2 года назад +53

    Some of these are so smooth, it's mind-boggling how detailed they continue to be! The bandwidth must be much greater than ever before, even with temporal decoherence!

  • @johelsen5776
    @johelsen5776 2 года назад +3

    The most present danger lies in that it will help make dismissal of genuine videos more credible. Adding to the disturbing trend by certain populists that shall not be named to declare ANY unfavorable claim "fake news" by default

  • @mergedlayers2153
    @mergedlayers2153 2 года назад +2

    Seeing the Mona Lisa moving is so satisfying

  • @ClayMann
    @ClayMann 2 года назад +9

    There's a whole community of people who want to do real-time streaming but they don't want to show their face on camera. So we've got these cartoon avatars that they make or have made for them. Some are more elaborate than others but they all lack any real human like emotion coming through. There is one, codemiko who has a very expensive setup and renders herself as a 3D character that looks game level realistic but its not really practical for the average streamer. I could see something like this really taking off and allowing more emotionally charged real-time streaming characters based on anime, movie or game characters. I wonder how long from this demo to it actually being a real product anyone can use with a phone filming their face. I'm guessing its months away. There's a big demand for this.

  • @shyamraa
    @shyamraa 2 года назад +2

    Judge : We have CCTV image showing you violated traffic signal. 🧐
    Me : DEEP FAKE! DEEP FAKE! 🤓

    • @kw4093-v3p
      @kw4093-v3p 2 года назад +2

      yeah except if nobody tampered with the footage then it can't be edited 🤓

    • @shyamraa
      @shyamraa 2 года назад +1

      @@kw4093-v3p Next Level Quantum computing OEM DEEP FAKE ! DEEP FAKE! 🤓
      It's just 1s and 0s.
      Skynet did it! 🤖

    • @thomasgoodwin2648
      @thomasgoodwin2648 2 года назад +2

      @@kw4093-v3p One now also has the burden of proof that the data has not been tampered with. Difficult at best, impossible at worst. The biggest winner here is lawyers, who'll use this to invalidate evidence or indefinitely delay trials.
      In either event, the use of any recorded media as slam dunk evidence is rapidly nearing a close.
      The only exceptions I see involve multiple vetted independent sources used to build a full case.
      As a side note I would just add the given the still fairly resource intensive nature
      of this stuff, the biggest players are still going to be state actors and multinational corps, for now. However, it won't be long before little Billy-Bob is popping this up on his Christmas I-pad.
      It's no longer a question of if this tech will work, but when. We need to start thinking about the consequences and prepare, or get run over by the truck when it arrives.

  • @gasparsigma
    @gasparsigma 2 года назад +22

    Wow, I've been following your channel for a while and you are much younger than I pictured in my head. Great technology and we need better understanding of science in politics, that's great 👏

  • @TeddyLeppard
    @TeddyLeppard 2 года назад +11

    People cannot (and should not) trust what they see or hear anymore. Unless you see something for yourself first hand, there is too great a chance it may have been edited or altered in some way.

    • @TheBeatle49
      @TheBeatle49 2 года назад +2

      And seeing something first-hand ain't so great either - consider the unreliability of eyewitness testimony.

  • @ImaplanetJupiteeeerr
    @ImaplanetJupiteeeerr 2 года назад +10

    I just wish all of these amazing tools would be open sourced and put together into useful applications for the hands of everyone!

    • @cdeford
      @cdeford 2 года назад

      They will be. Stable Diffusion, for example. Companies will want to exploit it, but others will copy the techniques and make it available.

    • @ImaplanetJupiteeeerr
      @ImaplanetJupiteeeerr 2 года назад +1

      @@cdeford Yes, that is true, but Stability AI is a rare exception unfortunately, even though I do wait to see what they will be able to accomplish in the future. I hope the landscape shifts, but so far way too many of these technologies are way too closed in my opinion. :)

    • @clarity2199
      @clarity2199 Год назад

      Actually, I think when this technology gets perfected, it's going to get scary. Kind of like website name addresses, I feel public domain actors and actresses of the past everyone's going to suddenly jump on board to try and claim their images as property.....from studios to average people, depending on the stars. Then families of dead stars will start suing, feeling they should own their image. Lawsuits will start up everywhere in order to own the dead! That's my prediction.

  • @marthinus.x
    @marthinus.x 2 года назад +7

    The one of Frida Kahlo is quite beautiful. I can imagine this will empower a whole new generation of image filters for social media.

    • @Sashazur
      @Sashazur 2 года назад +2

      Oh God please no… but yes I’m sure that’ll happen

  • @shaun_rambaran
    @shaun_rambaran 2 года назад +32

    As amazingly cool as the technology is, I really am concerned about the social implications of these styles of AI application.
    Not the obvious challenges like fake videos of politicians or 'deep fake porn'. But take the resurrection of dead actors, for instance: Would wearing a dead person's image like a mask tarnish the person's memory or reputation? Or what if we come to routinely bring back dead actors year upon year, would that affect the chances of new, would-be celebrities from their own opportunities to have their faces seen and so become future legends in their own right?
    What about us becoming even more obsessed about our looks than we already are? We could make much more physically attractive avatars of ourselves, and so long as noone meets us in person, we can have that be our faces. Maybe that's useful, true, but could that perhaps rob us, say, the personal growth that comes from learning to love our own faces and flaws? Coming to terms with ourselves, in other words, which we all need to do at some point in our lives for the sake of wisdom and good mental health.
    What will future society risk losing by all of this, and all that is to come?

    • @Plafintarr
      @Plafintarr 2 года назад +4

      Very interesting thoughts. I have no answers, just curiosity with a small pinch of worry.

    • @martiddy
      @martiddy 2 года назад +3

      About the avatar issue, I'm pretty sure you can already do that with current technology. Especially the ones that allow face synchronization for 3D avatars. However, the one in the video is better because the only thing you need as reference is just a 2D image. So even if you don't know how to create a 3D avatar for yourself, instead of paying an expert to make it for you, you can just download an image for any character you want and you will have your own avatar for streaming.

    • @shukrantpatil
      @shukrantpatil 2 года назад

      permission would be required from the actors before their death

    • @Tlalek
      @Tlalek 2 года назад +3

      Exactly what I thought. I understand why one can get excited by seeing such technology but the negative implications could be vast. Being a realist I'm sure there's no way to stop this growth, but as with any technology (like smartphones) we should talk a lot about the implications and actively prevent such technologies (more by self restraint than by law) from messing with our minds and societies.

    • @mal2ksc
      @mal2ksc 2 года назад

      If I could choose to apply correction whenever faced with a presenter that has one eye staring off in a different directions, then I could stand to watch Pete Thorn and Dave's Garage again. I like their content, but find the wandering eye extremely distracting and spend most of my time avoiding looking at the screen.

  • @veggiet2009
    @veggiet2009 2 года назад +5

    This definitely has the possibility to be very insensitive. I can imagine there would be quite an outrage if someone just tried sticking "Robin Williams" in their film today.
    Now saying that, I've had an idea for a long time that but would be cool to make a modern noir thriller starring Humphrey Bogart

    • @JorgetePanete
      @JorgetePanete 2 года назад +1

      With all these new deepfake/text gen AIs there's a lot of controversy but I think nothing can be done about it

    • @Sashazur
      @Sashazur 2 года назад +1

      For well known actors using their image for anything other than fair use will require approval from the actor’s estate, otherwise lawsuit. But I’m sure some will happen anyway.

  • @Zebred2001
    @Zebred2001 2 года назад +3

    I can't wait until this technology is combined with VR to produce immersive concert experiences like seeing the Beatles at the Cavern or on Ed Sullivan etc.

  • @RDD87z
    @RDD87z 2 года назад +7

    the problem is the movement, because if you just pause, that picture where you paused, will look real.

  • @MikkoRantalainen
    @MikkoRantalainen 2 года назад +6

    I'm fully expecting next paper to fix the temporal aliasing. I wouldn't be surprised if they already had a solution ready but they published this first to be able to publish multiple papers.

  • @StickerWyck
    @StickerWyck 2 года назад +7

    "trying my best to teach political decision makers from all around the world to make sure that they can make the best decisions for all of us."
    You can't be serious. The tech is amazing and all and not something I would see so soon, but the thought of these "decision makers" having yet another tool that helps them towards their ends is utterly terrifying.

    • @avidrucker
      @avidrucker 2 года назад +2

      I don't think he meant that he is giving politicians and world leaders deepfake technology. I think he was referring more to the teaching of ML awareness, safety, and ethical considerations.

    • @Sashazur
      @Sashazur 2 года назад +1

      @@avidrucker I’m sure you’re correct but inevitably teaching them about it will lead more to misuse it than who might have otherwise. But not teaching them is worse!

  • @Flawtistic
    @Flawtistic 2 года назад +4

    One step closer to being able to manufacture video evidence. What a time, indeed.

  • @pancakelegend
    @pancakelegend 2 года назад +3

    Emilia Clarke is safe for the time being. Convincing AI eyebrow emulation is a least 3 papers away.

  • @Spacecookie-
    @Spacecookie- 2 года назад +7

    While a lot of people look at this with noble intentions, many, many more will be looking at it to fool people, to scam, and to do selfish/morally bad things.

    • @healinbeet
      @healinbeet 2 года назад +1

      That is exactly what's stopping me from becoming excited about this.

    • @Zebred2001
      @Zebred2001 2 года назад

      I tend to agree but I just can't see how this technology won't get out for general use quite soon for good or bad!

    • @Aldraz
      @Aldraz 2 года назад +1

      This shouldn't slow us down. It's like with any technology that can be used for good or bad. And this type of technology has been here for almost a decade. It was at first used for "bad" things you could say, because it was purely used for porn. But then people started to use it to hide their identity for people who are anxious or shy and use it as Vtuber avatars for example. We should be more positive and optimistic about the future. Statistically the world is getting better place for all of us and is unrecognizeble to what it used to be 100 years ago.

  • @elekktronaut
    @elekktronaut 2 года назад +13

    Honestly, as impressive as this is, this is extremely worrying to me. I love your videos but it'd be cool if you talked about how this could be misused as well.

    • @hombacom
      @hombacom 2 года назад +3

      Well it’s not like we believe everything we see on internet

    • @rem7502
      @rem7502 2 года назад +2

      @@hombacom a significant portion on the population always does

  • @deloctyte
    @deloctyte 2 года назад +2

    Making the dead dance for us is an iffy subject for both fiscal and ethical reasons. Same goes for the art generators to a lesser extent: the thousands of art-pieces the ais "trained on" are seeing no returns on their works being processed.

  • @gwart8049
    @gwart8049 2 года назад +5

    Can you let us know when it is available for the public to test? I tried to reach out to the authors, but I don't know if they speak English.

  • @ingoos
    @ingoos 2 года назад +7

    Gaming & simulation graphics will soon be indistinguishable from reality!

  • @sirpsionics
    @sirpsionics 2 года назад +2

    It's interesting how you can get a picture in your head of what someone might look like based on their voice, but when you see them, they look like nothing like you imagined.

  • @Skeptical_Numbat
    @Skeptical_Numbat 2 года назад +4

    There must be hundreds of actors, musicians & famous scientists I'd love to see, but to see Christopher Reeve as Superman again would be stunning.
    I expect we'll have another Disney Star Wars series - starring a young Han, Luke & Leia - coming out pretty soon...

  • @theycallme_nightmaster
    @theycallme_nightmaster 2 года назад +2

    ohhh coool celebrities!!!!! they definitely won't use this stuff to track us like cattle, it will definitely be used for fun concerts!! :)

  • @BigMTBrain
    @BigMTBrain 2 года назад +1

    It's so funny!... Near the end when asked "What actor would you like to see revived this way?" My first and always thought - PRINCE! 😀First suggestions after the question: Prince or Robin Williams. 👍

  • @willdarling1
    @willdarling1 2 года назад +2

    yay - now they can stop constantly looking for new Bond actors, and just make new films with Connery and Moore.

    • @Sashazur
      @Sashazur 2 года назад

      But it’s not really them. More like a puppet that looks exactly like them. Their personality is totally gone and that can’t be faked.

  • @dollocaris_ingens_7747
    @dollocaris_ingens_7747 2 года назад +1

    2:07 i didn't read the text at the top of the screen first and thought it was the other way around for a second. that just shows how good these deepfakes are.

  • @guepardiez
    @guepardiez 2 года назад +1

    "If you have been holding on to your papers so far, now squeeze that paper." Instructions unclear. Which one of the multiple papers I'm holding on to should I squeeze?

    • @JorgetePanete
      @JorgetePanete 2 года назад +2

      Squeeze them until they become one

  • @michalbernhard2068
    @michalbernhard2068 2 года назад +5

    Imagine that actors will just license their face and they won't do any real acting work. And that you can revive or use any person for this purpose. This will completely change movie industry in the future.
    Btw is it possible to approximately calculate how much does it cost to create those models and to run them? Generally for every demo we can see here. It's good indicator how long does it take before it start to be used in practice. Thanks.

    • @trm7782
      @trm7782 2 года назад +2

      Why even license real actors when they can generate the exact face they want using another model

    • @cgbasic808
      @cgbasic808 2 года назад

      how tf you comment before the video comes out

  • @ww07ff
    @ww07ff 2 года назад

    1st scene of Terminator 4 brought a young Schwarzenegger, in a indistinguishable "real life" video quality. Mind boggling impressive.

  • @solanumtuberosa
    @solanumtuberosa 2 года назад +3

    Finally now everyone can make their canon version of got s7

  • @delpinsky
    @delpinsky 2 года назад +2

    Woow! 🤩 Super cool step forward! From a 2D image... mindblowing.

  • @i3looi2
    @i3looi2 2 года назад +4

    As a wise scholar said once:
    The internet is for porn.

  • @aurelienyonrac
    @aurelienyonrac 2 года назад

    Really amazing. 1:30 lower left error with the guy's hair on the face

  • @WimerC10
    @WimerC10 2 года назад +1

    I'll be thanos and speak about biology.
    With this, many good and bad; cursed and memeable things will come.
    I'm waiting the meme and cursed ones.

  • @gwart8049
    @gwart8049 2 года назад +2

    Definitely the best copy deepfake so far. Better than wav2lip, first order model, and thin plate spline motion model. I hope it's easy to use and doesn't give a limit.

  • @MoviesRemastered
    @MoviesRemastered 2 года назад +1

    You had 11k views with 1k likes after 1 hours. I like this!

  • @tomgon3D
    @tomgon3D 2 года назад +5

    Good news for VTubers. Worrisome in regards to fake news

  • @EinJamaisVu
    @EinJamaisVu 2 года назад +2

    Would absolutely love that for roleplaying games, also throw in a voice deepfake and we can take it to a whole other level!

    • @Miss-Nadia
      @Miss-Nadia 2 года назад

      I like the way you think.

  • @Solizeus
    @Solizeus 2 года назад +3

    Can't wait to not trust images and videos ever again

  • @lasselehma
    @lasselehma 2 года назад +1

    I don't want any dead person being brought back as a puppet without their consent.

  • @jameshughes3014
    @jameshughes3014 2 года назад +2

    I feel like, just as a matter of taste, we shouldn't animate anyone who passed in the last 30 years.

    • @Zebred2001
      @Zebred2001 2 года назад

      I tend to agree but I just can't see how this technology won't get out for general use quite soon!

    • @jameshughes3014
      @jameshughes3014 2 года назад

      @@Zebred2001 I think it's just up to us to decide what we should and shouldn't do with it.

  • @stephan4932
    @stephan4932 2 года назад +1

    My biggest dream will be a good ending to the game of thrones saga made as a huge community affort

  • @雪鷹魚英語培訓的領航
    @雪鷹魚英語培訓的領航 2 года назад +2

    Imagine the 12 year old or younger kid who will be interacting with the professional world with an adult avatar undetected.

  • @nickasher7105
    @nickasher7105 2 года назад +1

    if only JOKER had studied to be an AI Researcher, he would have made everyone smile

  • @greevar
    @greevar 2 года назад

    Before you even said it, I was thinking of Robin Williams. That man was something special.

  • @mysimpletoon
    @mysimpletoon 2 года назад +1

    Wow. 10 years from now I don’t feel like I can trust anything online... fake videos and scams are going to be apocalyptic

  • @jeffreybeitel1291
    @jeffreybeitel1291 2 года назад +1

    Good sweet papers I love you. keep up the terrible puns and the great work. Hahaha

  • @clumsymoe
    @clumsymoe 2 года назад

    I love when Dr. Karoly says "squeeze that paper" 😄

  • @bcafed
    @bcafed 2 года назад +3

    The worrisome point will be when the AI simulations surpass what is able to be detected. That day will be here soon.

    • @Ebani
      @Ebani 2 года назад +1

      Nah, just use an AI for that, i mean that's what they already do 😅

    • @bcafed
      @bcafed 2 года назад

      Yes, of course. Károly is speaking to government officials because AI will fix everything.

  • @BlackEagle352
    @BlackEagle352 2 года назад +1

    If i go back in time to show DaVinci the deepfake Mona Lisa, he would be like: i have already sketched the code for this, it must be somewhere scattered up the attic.

  • @JustWasted3HoursHere
    @JustWasted3HoursHere 2 года назад

    I have to say that you look nothing like I imagined, Dr. Zsolnai-Fehér! I would like to see Carrie Fisher (Princess Leia from Star Wars) brought back to meet Luke, Han and Chewy since they did not get a chance to reunite in the sequel trilogy!

  • @randomstream4130
    @randomstream4130 Год назад

    I love how exited he sounds

  • @DistructiveElements
    @DistructiveElements 2 года назад +1

    This is will be awesome for translating language between films

  • @PixelPi
    @PixelPi 2 года назад +1

    Ingrid Bergman, Bette Davis, Joan Fontaine, Audrey Hepburn, and/or Vivien Leigh.

  • @rb8049
    @rb8049 2 года назад +2

    We see pieces of solutions across the papers, but still don’t see physics, full denoising, temporal coherence, etc. applied at the same time to generate the perfect solution. Means it should be coming soon.

  • @shiftless215
    @shiftless215 2 года назад +2

    This might sound weird but I don’t know how good this would be for the music industry tbh, artists are already worth more when their dead, when this stuff all works, they’d even be able to still appear in media making the artist be worth even more when dead, and will be able to be used by corrupt people to be milked dry for money until they go onto the next artist.

  • @slendi9623
    @slendi9623 2 года назад +5

    Woah, this is in. sane.

  • @nodelayfordays8083
    @nodelayfordays8083 2 года назад +1

    I fear we have to answer some philosophical questions

  • @CharlesVanNoland
    @CharlesVanNoland 2 года назад

    Another great application: do yourself up with your Sunday's best, all fancy and nice, and then for Zoom meetings you can use that as your appearance in spite of being still in your pajamas without having taken a shower yet. :D

  • @hokutonokenny
    @hokutonokenny 2 года назад +2

    The Catfished channel is going to explode.

  • @gmaiI
    @gmaiI 2 года назад +1

    Seems VR will be hyper realistic pretty soon, instead of shapes made of triangles .

  • @genebeidl4011
    @genebeidl4011 2 года назад +2

    Can we download this pre-trained model?

  • @HungrySandwitch
    @HungrySandwitch 2 года назад +13

    Can you quantify real time? Does that mean a chromebook can do it in real time or are we talking rtx3090 can do it in real time?

    • @richmeister4eva
      @richmeister4eva 2 года назад +4

      I'd say it's prudent to err on the side that it needs large computational power to achieve the results. That way you're either right or pleasantly surprised :)

    • @4AneR
      @4AneR 2 года назад +1

      For this paper, it's a 30 fps 1024x1024 resolution with desktop rtx3090. With lower resolution you get much better framerates with mediocre GPUs too

  • @evanavich6969
    @evanavich6969 2 года назад +1

    tries to make them come alive by making the most robotic head movements of all time lol

  • @spiderbite7849
    @spiderbite7849 2 года назад +1

    I wonder if this could be used for video conferencing. Instead of sending over a compressed 12fps video that is low res and delayed, send over just the co-ordinate data of the face.

  • @RahulGupta-qg1gu
    @RahulGupta-qg1gu 2 года назад +1

    Imagine watching Steve jobs movie, with actual Steve in all the scenes rather than an actor.

  • @maxmyzer9172
    @maxmyzer9172 2 года назад +2

    the problem isnt that you can put it into a deepfake detector, the problem is the average person won't

  • @LKDesign
    @LKDesign 2 года назад +1

    I assume the current way of using doubles under a high-fi CGI face will stay in professional film production. Lower budget productions might possibly take this approach though.

  • @eSKAone-
    @eSKAone- 2 года назад +2

    Look at where we are, not at where they promise we'll be.

  • @switzerland
    @switzerland 2 года назад +1

    According to a random tweet we can expect the best machine learning models to improve by another 5000x in the next 4 years. This due to hardware, software and budget improvements.

  • @gregap8282
    @gregap8282 2 года назад

    Imagine taking security footage, replacing the face and posting it on social media.

  • @cristoforcasto2400
    @cristoforcasto2400 2 года назад +1

    You should check out Kyle Dunnigan's work with Kurt Metzger. He's does some pretty neat satirical impersonation content using primitive deep fake sw. When a deep fake has the whole package from someone who is good at mimicking their mannerisms too it's really great (Kyle's a comedian so they're super exaggerated). I can't imagine him getting his hands on the good stuff.

  • @vitruviuscorvin3690
    @vitruviuscorvin3690 2 года назад +1

    I absolutely love your scientific curiousity, it's that true l'art pour l'art vibe, but with deepfakes getting better and better, I find it mildly horrifying, and this is the point to paraphrase the great Jurrasic Park question: "the scientists were so preoccupied whether they could, they forgot to ask themselves whether they should". I also think no actors should be brought back and I would also be a bit concerned on making filmmaking and other arts more accessible to create with these, with quantity outnumbering quality, uniqueness, the challenging process of creativity would lead to art and creativity fatigue and inflation. Not to mention the security issues, etc.
    To be fair, this would definitely could bring in a new way of understanding history. I loved the paintings part, how awesome is that!

  • @homer3189
    @homer3189 2 года назад +1

    Which celebrities should be revived with this technology? NONE.

  • @mrhouse_v21
    @mrhouse_v21 2 года назад +1

    The fact that it's real time is insane.

  • @alexshultz
    @alexshultz 2 года назад +1

    I want the BBC to use this to recreate the missing Dr. Who footage from the first two Doctors.

  • @ngbrother
    @ngbrother 2 года назад

    Robin Williams is impossible to fake. His facial expressions are too unpredictable. :-)

  • @arafatamim
    @arafatamim Год назад

    Damn, The Capture (TV show) can now be a reality!

  • @BoogerDad
    @BoogerDad 2 года назад +1

    You will undoubtedly scare people when the first movie comes out and the actor makes a statement about not getting paid or even remembering the shoot...

  • @mikejones-vd3fg
    @mikejones-vd3fg 2 года назад

    thats cool but i was more blown away with the different angles of mona lisa and others you never seen before and wish the drivers would stop moving around so much so i can absorb it, amazing, bring a whole new life to these people we just knew from 1 angle, the mimicing thing is cool too, but could we perhaps check out mona lisa's dress? thats just "not enough information" for the ai to produce i bet... oh well, cant making something out of nothing, well the universe is here so lets not count that out yet.

  • @armandoarmandez5018
    @armandoarmandez5018 2 года назад +2

    Is there any way in which I can use one of these, I’m an artist and I love to see my drawings come to life

  • @bossgd100
    @bossgd100 2 года назад +2

    Where is the code for the last demo ?

  • @pridefulobserver3807
    @pridefulobserver3807 2 года назад +1

    5 to 7 years from now, giga pixel smooth deepfakes, now every video on the internet about anyone is just hearsay

  • @dubhd4r4
    @dubhd4r4 2 года назад

    Thanks for your work explaining this to the public and policy makers! It's great to see someone very knowledgable making the implications of this technology accessible. DeepFake detectors do exist and AI does not need to be locked away because of "ethics concerns!"

  • @martiddy
    @martiddy 2 года назад +2

    With this technology, now we can have more realistic avatars for vtubers with better face expressions and lipsync.

  • @rdcdt6302
    @rdcdt6302 2 года назад +1

    Translate movie with coherent mouth movement!

  • @TravisHi_YT
    @TravisHi_YT 2 года назад +2

    "What actor or musician would you like to see revived this way?"
    None, please let them rest.

  • @sir_wesley86
    @sir_wesley86 2 года назад +1

    AI could technically, soon, live on as actors who have passed. insane!

  • @TundeEszlari
    @TundeEszlari 2 года назад +2

    Fantasztikus lett a videó, csak így tovább.😊

    • @Sekir80
      @Sekir80 2 года назад

      Kíváncsiságból: hogyan lett 173 feliratkozód anélkül, hogy bármit mutattál volna a világnak?