This AI Stuntman Just Keeps Getting Better! 🏃

[@looksintolasers]

Two Minute Papers has taught me that when humanoid robots come for us, they won't be clunky C-3POs with stiff movements, they'll be terrifying masters of parkour.

[@stevetennispro]

@Train of Taught Great idea! I even have a name for it... ParkourMON

[@champion3433]

Boston dynamics has made me genuinely fear robots

[@flashstick]

@Train of Taught m.ruclips.net/video/a30K69hUJyo/видео.html

[@blissweb]

And there will be nowhere for us to hide (open ai hide & seek)

[@96dragonhunter]

Just like Elon Musk said "AI is the true threat of humanity".

[@b3nsu]

Something like this implemented in a game engine would be insane. Completely procedural animations for characters and nps would take immersion to whole new level

[@R2Bl3nd]

I'm imagining a fully physics based game where your character can actually trip over stuff like pebbles, or slip on things, and it would use completely realistic physics to simulate that. Might be annoying sometimes, but certainly more realistic.

[@ArunNairOne]

@@R2Bl3nd Or perhaps even allow users to set the degree of physics realism if it gets annoying

[@nerobernardino88]

Imagine that but in Mount & Blade.

[@PolishProgrammer]

@@R2Bl3nd exanima

[@JoRoBoYo]

@@R2Bl3nd death stranding

[@kappascopezz5122]

It's hard to believe that this is an actual physics simulation and not a motion-capture animation

[@cw9249]

Yeah seriously, what physics simulator is this? I’ve never seen it before. This is definitely not open source I would assume

[@kappascopezz5122]

@@cw9249 I don't think the physics simulation itself is that extraordinary, the reason why I think it's incredible that they put it in a physics sim is that modeling and controlling a human in a way that looks like realistic human movement becomes much harder when you're constrained by the laws of physics, and can't just record a movement that is just played back without being integrated into the world.

[@Nawmps]

I absolutely love how confidently the agent fails, full commitment to breaking their spine on the ground!

[@bitbraindev]

Imagine, Boston Dynamics roboters with this technology. What a time to be alive (for now)

[@user-ik8vy1rg8f]

I think it is the same technology. It's machine learning right? Neural network based training?

[@xxbatman69xx98]

@@user-ik8vy1rg8f yea it’s the same thing. They also use machine learning, so they will do something like show them how to do a course and it will do it. But it needs to learn how to keep its balance and everything else which it will learn through trial and error.

[@huracanrdgz3956]

(For now) XD

[@TheHeavenman88]

Tesla bot will try this before them .

[@maestro3676]

@@xxbatman69xx98 I've heard that they mostly don't use machine learning, and not much is known at all
Although they may be working on that at the moment

[@MasterVertex]

This is taunting me as I learn body mechanics in animation. By the time I can do it well, we'll have the 'animate' button

[@jfk_the_second]

Switch "well" for "we'll" so that you don't confuse even people who don't care about grammar.

[@jfk_the_second]

If you want to level it up again, put a comma right after "it". That will be even less confusing.

[@akaakaakaak5779]

i suspect you said this as a joke but i think it should be a genuine concern tbh. make sure youre not investing your efforts into an industry thats going to vanish in a decade

[@Ogaitnas900]

There's no replacement for personal expression! :) no machine can animate like you personally animate, or even you in a particular mood or day.
I'm sure you know that, just wanted to say it, keep it up animation is awesome, it's really cool that you're doing it.

[@senritsujumpsuit6021]

P3ople have said that stuff years ago sooo

[@scproinc]

Can't believe how Freeza got beaten so easily. WOW!

[@user-ik8vy1rg8f]

Video games with next gen AI are gonna be fire!

[@badjano]

That’s because they took off his tail

[@Wakish0069]

You must have missed Trunks' intro in the Cell Saga

[@DoodleChaos]

3:07 I wish I was cursed with that crazy configuration 😏

[@7Dimensi0ns]

Haha hey there DoodleChaos! Love your vids =D

[@decodedbunny101]

god

[@PhillipAmthor]

乇乂ㄒ尺卂ㄒ卄丨匚匚 configuration

[@Grocel512]

I had that long leg / long arm configuration too. But my motor skills were buggy as hell and it had strength issues too. Fortunately there was a patch that increased the thickness of legs / arms too. That fixed the strength issues and my body runs much better now. But my motor skills are still shitting the bed during sports. 😂

[@sackboy1665]

pixar moms

[@LNYuiko]

Holy crap, I've never seen such an explosive punch animated before. Not even motion capture can quite get to that level because the animation often does not translate to the physics of the game.

[@foxmamer]

Is no one going to comment about the fact that it looks like the model broke one of its ankles after every running jump?

[@historyZZ]

I think that’s it’s “rebalancing” after the jump but it just does it very poorly.

[@oblivion_2852]

It's because the before and after movement isn't being optimized simply the jump is. If the walking/running action were optimized it would probably get rid of that

[@historyZZ]

@@mnomadvfx honestly I don’t know much about ai. But after seeing ai made in mine craft more complex then this it kinda degrades the fascination. And people’s are comparing this to boston dynamics is hilarious. Boston dynamics, besides for industrial use and military is the best quality you can compare to. And it’s not even there.

[@bukpuki]

@@historyZZ you should've stopped after the first sentence lol

[@historyZZ]

@@bukpuki please explain how ai on a software is more fascinating then the software on real life robotics?

[@Z0MBUSTER]

This paper keeps jumping all over the place, lovin' it !

[@Robert_McGarry_Poems]

😋 Narf!

[@stevetennispro]

Too true! I would have to classify the paper as a "technological leap". ;)

[@yugen3968]

Trivia - The first sport to be incorporated into the AI-lympics was the high jump.

[@DEEPANJANBISWAS]

😄👍👍

[@emperorsascharoni9577]

The day it figures out the Fosbury Flop by itself is the day I believe AI can do anything.

[@yugen3968]

​@@emperorsascharoni9577 That was the first thing that came to my mind when the wall was raised! Either it hasn't figured it out yet, which is kind of weird as there have been papers earlier where virtual agents adjust their limb & joint configurations to most efficiently tread a terrain - OR - it's possible there's some sort of rule in place for it to preserve the vertical orientation throughout the movement. But, yeah, figuring out the fosbury flop will make it a lot easier for it! That'd be so dope!

[@pokemasterJAH]

I’m loving the pace of AI! I’m just starting off at college and with some influence from your videos I have decided to pursue a career in machine learning! You make such excellent work and I feel so inspired every time you post!

[@NirousPlayers]

*(Watching two minute papers fills you with determination)

[@Nobddy]

I would love to have a video game where the character’s movement was determined by this AI so that as you progressed through the game the AI would slowly get better at the characters move set. By the end of the game you would be able to pull off moves that would have been unthinkable at the start of the game.

[@ArunNairOne]

Amazing! I won't be surprised if in a few years we will have AI-based workout apps that suggest highly customized exercises based on your body type and body mechanics. Indeed, what a time to be alive!

[@kanekaiiishoyo3378]

Yes

[@shipwreck9146]

Woahhh, this would be an incredible use for it.
I was also thinking it could be used as a way for Olympic athletes to hone their techniques.

[@troooooper100]

Makes no sense

[@Nobddy]

Machine: “jump higher”
You: “how?”
Machine: *plays video of sim jumping over a sky scraper
“It is possible”
You: *weak, sad, shuddering
yes, master.

[@doomakarn]

I feel that in the future, this is how characters will be animated.

[@koko969w]

I love the humor! keep up the amazing work, I've been following for years and I still click on every video!

[@JordanClark82]

Do you notice the walking motion after the jump is very awkward? It seems to be dragging its legs forward with stiff ankles

[@JoachimSauer1]

Notably that awkward walking motion was already in the reference! So it probably learned that and had no reason to "unlearn" it (i.e. its presence didn't affect the fitness function).

[@JeyPeyy]

I got sad for the AI hurting its ankle each jump

[@randomthoughtism]

Yup, to me, the biomechanics seems wrong for humans but adequate for manikins being simulated by AI.

[@TheJonathankang]

Probably because the bot is devoid of pain sensors and it's bones and joints are indestructible, so there's no need to improve landing posture to minimize negative impact on bone and joint integrity.

[@JorgetePanete]

Exploration like this is what could help AIs play games too, refining independent tasks and not just trying to achieve a high score in a long run

[@davidwuhrer6704]

Not all games even have scores. And the AI that plays old Atari games can finish those, too.

[@JorgetePanete]

@@davidwuhrer6704 I was referring to the fitness function in neural networks for playing

[@MushookieMan]

I thought it was going to spontaneously re-invent the Fosbury flop. No such luck.

[@andrasbiro3007]

I think here was a previous AI that did it. This one was specifically told to use the same move.

[@C_Corpze]

I can imagine this being used for movies, animations and even games where characters learn new moves while playing! That sounds like such a amazing thing. I'm excited for the future.

[@davidwuhrer6704]

A game in which the player character improves movement over time would be amazing.
In Assasins' Creed, the player avatar adjusts movement to the environment, but it is pre-captured motions stitched together.
In GTA San Andreas, the player avatar can change its body shape depending on food and exercise. This then changes jump height, running speed, lung capacity, and how many hit points a punch subtracts from the target.
I'm thinking a game in which the player avatar acquires new ways to adjust movement to the environment and to changing body shape would be quire exciting.
A completely different thing would be AI agents learning movements from each other. There are many possible gaits, for example, which could propagate as memes through a population. I'm not sure how to make a game idea out of it, and it would be a lot more computation intensive, but I think the concept has potential.

[@dionyzus2909]

that jump on 0.3 gravity looks so happy.

[@imjody]

This is honestly so incredible. Very useful for video game devs! Imagine, each pixel used to have to be colored in, per frame, then we got into 3D, but every single move had to be precision placed by an animator, and now and into the future, the AI will just do it all for us. We say do X, AI will do X in 1 trillion different ways. I love it. I absolutely love it all. Thank you yet again for an awesome presentation of what's going on in these fields, Two Minute Papers. :)

[@kenosabi]

Sometimes the world is too much but this channel always makes me happy to be on the planet regardless of what's falling apart.

[@mahadevovnl]

It would be very cool if a model would also predict its own risk of failure, and decide "I'm not going to make this jump, so I'm not going to try".

[@idontknow8898]

Is there a channel dedicated just for this content? It's incredible watching this evolve!

[@TobbyTukaywan]

I wanna see 2 AIs fighting each other. That would be insane.

[@nou4898]

2:04 including phasing through solid blocks

[@shipwreck9146]

It'd be so cool if everything on this channel was somehow implemented into 1 game.
Like, a full game with realistic physics, ai optimized graphics, ai character movement.
This is a very interesting future we're moving into.

[@AICoffeeBreak]

Is this impressive? Yes. Yes, it is.

[@RichardCraig]

2:22 - I would absolutely LOVE to see an AI fail video! It's always so hilarious to see these little failures, pure physical comedy gold!

[@josephhansen1598]

...or go full Mike Tyson on the opponent 😂

[@davidwuhrer6704]

Bite off an ear?

[@max4644]

That's very similar to what Mike Tyson does actually, look at what it does with its legs and compare it with Mike. Crazy!

[@arvindwee4634]

Today I learned that Professor's name is spelled - Károly Zsolnai-Fehér
.

[@zeekjones1]

Now stick this into Disney's robot aerialist.

[@phpn99]

Next step : Put this class of algorithms in the brain of Boston Dynamics' robots

[@None_NoneType]

I love your channel so much, I’ve been watching your videos for months and haven’t even started college yet

[@bigdaddy5303]

Poor guy looks like he did a hammy after the first jump

[@jcoludar]

This is the best thing I've seen in my life! This AI opens so many possibilities!

[@GoodBaleadaMusic]

The perfect quintessential 2 minute paper video I love this channel so muuiuacacajajja!!!!!

[@LanceThumping]

I'm gonna have to read about this. Hopefully it's good enough to run in real time because I'd love to see this stuff put to work in making a video game where the main character moves much more fluidly.

[@ToonedMinecraft]

I think it is, they control it with a controller at some point.

[@hoptanglishalive4156]

Move over, Boston Dynamics Atlas. There's a new kid on the blocks.

[@gokuldas027]

"..but, do you know what else it can deal with?" obviously our sponsor... oh ohh.. "hold on to the paper, squeeze it"

[@shilohv]

Interesting how the model character slows down before each obstacle. A human would use his/her momentum with anticipation for the next hurdle as soon as the previous one was complete.. The AI bot seems to rely on her muscular structure and close-up evaluation of each block. I would suggest adding to her programming the ability to analyze from more of a distance or to analyze the entire course before she begins her movements.

[@user-ik8vy1rg8f]

3:19
"Baby Legs, here we go!"
[Baby Legs makes whirring noises]
"That’s the sound I make when I’m trying to run fast."
― Baby Legs Detective (Rick and Morty)

[@Stafford674]

Would it be possible to develop a bot that boxes like Tyson at his peak, another that boxes like Ali at his peak, and set them against each other to see who would win?

[@USBEN.]

I can imagine people actually having boxing matches with different trained AI. Maybe WWE AI as well. Would be dope.

[@yosha_ykt]

Yeah

[@agsystems8220]

I guess, but you wouldn't know the specific preparation and strategy each would apply, or the plans each would have. There simply isn't enough data to understand that, particularly if you are trying to hit a specific moment in their career.

[@ronwhitehouse23]

I just love this man's voice he is so cool!

[@NyelleUnbroken]

I really love how u present these papers man; idk- don't ask me to describe it
u are just amazing sir...in the most geeky (in a good way) one can possibly say
ty for capturing the excitement in the most appropriate way- bravo

first time me attending your video uploaded 1 minute ago, cheer up Doc!

[@ApontyArt]

Dear fellow scholars,
This is Too Many Humans, with Károly Zsolnai-Fehér. Wow! What a time to be simulated!
What a time to be AI!

[@davidwuhrer6704]

Mind backups, when?

[@Aanthanur]

The best statistics channel on YT :D

[@RichardCraig]

4:24 - I love that WHEEEEEEEE pose, lol!

[@garronfish8227]

Two papers down the line and we will be hooked to AI MMA

[@kubenjoy3888]

this is what the game Indurstry needs and not fancy graphics! I love these kind of paper!

[@geli95us]

IMO, it needs neither, games are about entertainment, not realism, it's not like we can't do smarter AI for games, we just decide not to because it wouldn't be fun

[@MaestroTunes]

@@geli95us games like gta would 100% be improved by having this because it wouldnt constrain u to just a few ways of hitting and breaking cars you could choose 1000s of different animations or even train the thing yourself you would have more climbing things like that

[@lucas3820]

thanks for putting subtitles so i can watch your videos.

[@Vennotius]

It's all very entertaining until robocop chases you down and punches a tunnel through your ribcage.

[@BsktImp]

00:54 When he said "hold on to your papers" I was expecting the figure to have demonstrated convergent evolution and used the Fosbury flop!

[@Y2Kvids]

Boston Dynamics wants to know your location with Bags of CAsh .

[@tehquiper6796]

After getting defeated by Goku for the Nth time, Freiza was sentenced to become a training dummy in this paper

[@chewycornell]

This would be great for npcs in games that don’t have a predetermined path to follow

[@emanuel3617]

Boston Dynamics: 📝👀 mmmmm interesting "AI punch"

[@bobsbbcards]

The bot sort of has a zombie shuffle after hopping over the wall.

[@UtraVioletDreams]

Once I played PONG on our TV back in the 70's or so. Who would ever believe back then we could get to this level.......................
Supper COOL.

[@davidwuhrer6704]

Isaac Asimov, that's who.
Of course hardly anyone believe him back then.

[@pukarkhatri]

It just keeps Getting Better!

[@eaaeeeea]

This is seriously next level for gaming! And T-1000s.
Kidding aside, it's so strange of a notion that character movement won't soon be "hard coded", but only a single DL model.

[@davidwuhrer6704]

Don't you mean T-800s?
Huh, now I wonder how a T-1000 or a T-X would fare against a Transformer from Cybertron. Second Variety has nothing on them.

[@TAREEBITHETERRIBLE]

YAH I LOVE THE DOCTOR I AM HOLDING ONTO MY PAPERS.

[@yash1152]

0:42 1:07 oh gosh, the left leg's limping though
2:17 geez, it's suppper prominent and beyond the scope that i can ignore it

[@desu38]

Oh god, the Ikea employees know parkour!

[@Marsnarchy]

Imagine a game similar to this, and with your skill level raises the pa(Procedural animation)'s capabilities. like without a level you can do basic jumps, climb things, etc.. but with a higher level you can do all kinds of different jumps, vaults, and swings.

[@johngarcia4139]

It's learns like a human with no physical limits

[@scene6289]

Ah i always love machine learning and seeing them adapt to different situations

[@ShimonD]

I'm addicted to your voice. Absolutly amazing.

[@dylanjones8433]

Great video. Thank you!

[@johnclark926]

AI stuntman now, Robot stuntman two papers down the line

[@eragon_argetlam]

Absolutely incredible! What a time to be alive!

[@abderrahimbenmoussa4359]

Congratz on the million followers

[@rafaxsworld]

as a 3D artist and animator this papers amaze me so much, what a time to be alive!

[@fortisjann]

What a time to be alive.

[@_____alyptic]

Changing body proportion is interesting, but how about just one arm longer or one leg slightly shorter instead of both?
...Would it still be able to cartwheel or do the other tasks?

[@andremarques3317]

probably yes, each one has its movements calculated individually, just like the legs. This categorization of arms and legs for an AI is more a human concept than an actual code thing

[@StephenRayner]

This is really cool, well done guys who made this! Well done!!!

[@numero7mojeangering]

Now i'm dreaming to 3d print a full body robot in real life and have the IA takes the control of the body ! 👌😆

[@mr.norris3840]

That AI is clearly made by Disney

[@loading420]

3:18 this scp has breach its containment

[@canoafurada1105]

i like how in the first video after the jump it walks like if it had hurted

[@rootyroot]

You can imagine in the future - boxing AI vs AI or maybe AI (in a physical form) vs humans.. We are going to learn so much from AI

[@PandicMan]

Really interesting to see its applications in the future

[@taureanwooley]

Hopefully they'll be able to compute the failure consequence in the movements to hopefully offshoot some of the damaging effects, but then again that could limit some of the requirements suggested to make a successful climb indefinitely beyond certain generations.

[@Bat0541]

I fuckin love this channel.

[@firiasu]

2:01 It's so funny, I can't stop watching.

[@landanhoward7208]

this reminds me of the baymax movie where the kid teaches his robot to do things

[@serahwambui674]

The physics behind this 👍

[@ModBros8434]

It would be very fun to put the AI in a superhuman body and watch it do insane moves

[@drodsou]

After chess, go and starcraft I'm seeing the first human-robot mma fight approaching.

[@nzuckman]

Damn that agent's got some junk in the trunk

[@swawssfm9760]

imagine a game where there are zombies chasing after you like this

[@davidwuhrer6704]

Like that old game _Robots_ where you have to trick the machines rushing at you into crashing into each other?

[@Asterra2]

I guess if you had unlimited strength in your ankles, you could pull this off also.

[@NonisLuck]

I LOVE THESE VIDEOS AAAAAAAH!

[@surajvkothari]

Let's just hope this technology is used for good in video games rather than the real world. What a time to be alive, for now!

[@davidwuhrer6704]

Why shouldn't it be used in the real world? Parkour robots would be amazing. Boston Dynamisc is already doing something similar with robots intended for elderly care, which in an aging demographic is desperately needed.

[@CE-ov7of]

Does this mean that once we have 'perfect' simulations of our environments and robots, the AI robotic coordination problem can be sufficiently solved, and then transferred to the real-world robots?
Image self-play for hand-to-hand combat....

[@egdm1235]

"Image self-play for hand-to-hand combat...."
Imagine the viruses and hacks in that scenario...

[@CE-ov7of]

@@egdm1235 Lol I would have figured the humanoids would have been constrained to their emulated environment, but never considered the possibility to 'break out' of their bounds haha that would be a mess!

[@VarenRoth]

Ngl between "self-play" and "hand-to-hand" my mind went far from combat.
..Still, same issues with uh.. viruses, yes.

[@davidwuhrer6704]

@@egdm1235 What if we just don't install a web browser on those things?
Remote code injection is considered a bug in every piece of software except in web browsers, where it is a feature somehow.

[@LNYuiko]

This is pretty much what they're doing with self-driving in Tesla and it is working extremely well. So yes, eventually you will have a humanoid robot that will learn through simulations and be almost perfect in execution in real life.

[@briankirkpatrick8888]

Did you guys catch that low gravity jump at 4:26? You could use this to predict realistic motions for people on the Moon or Mars. I'd love to see a sci fi that does this. You could do their everyday motions, sports, ballet, martial arts, really conveying that "this isn't earth anymore" feeling.

[@katphisH11]

Miyazaki: I have friends who have bodies and they have different limb lengths and energy levels. This is an insult to life itself.