This AI Stuntman Just Keeps Getting Better! 🏃
HTML-код
- Опубликовано: 11 сен 2024
- ❤️ Train a neural network and track your experiments with Weights & Biases here: wandb.me/paperi...
📝 The paper "Learning a family of motor skills from a single motion clip" is available here:
mrl.snu.ac.kr/r...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Haro, Andrew Melnychuk, Angelos Evripiotis, Benji Rabhan, Bryan Learn, Christian Ahlin, Eric Haddad, Eric Martel, Gordon Child, Ivo Galic, Jace O'Brien, Javier Bustamante, John Le, Jonas, Kenneth Davis, Klaus Busse, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Mark Oates, Michael Albrecht, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Ramsey Elbasheer, Steef, Taras Bobrovytsky, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: discordapp.com...
Károly Zsolnai-Fehér's links:
Instagram: / twominutepapers
Twitter: / twominutepapers
Web: cg.tuwien.ac.a...
#gamedev
Two Minute Papers has taught me that when humanoid robots come for us, they won't be clunky C-3POs with stiff movements, they'll be terrifying masters of parkour.
@Train of Taught Great idea! I even have a name for it... ParkourMON
Boston dynamics has made me genuinely fear robots
@Train of Taught m.ruclips.net/video/a30K69hUJyo/видео.html
And there will be nowhere for us to hide (open ai hide & seek)
Just like Elon Musk said "AI is the true threat of humanity".
Something like this implemented in a game engine would be insane. Completely procedural animations for characters and nps would take immersion to whole new level
I'm imagining a fully physics based game where your character can actually trip over stuff like pebbles, or slip on things, and it would use completely realistic physics to simulate that. Might be annoying sometimes, but certainly more realistic.
@@R2Bl3nd Or perhaps even allow users to set the degree of physics realism if it gets annoying
Imagine that but in Mount & Blade.
@@R2Bl3nd exanima
@@R2Bl3nd death stranding
It's hard to believe that this is an actual physics simulation and not a motion-capture animation
Yeah seriously, what physics simulator is this? I’ve never seen it before. This is definitely not open source I would assume
@@cw9249 I don't think the physics simulation itself is that extraordinary, the reason why I think it's incredible that they put it in a physics sim is that modeling and controlling a human in a way that looks like realistic human movement becomes much harder when you're constrained by the laws of physics, and can't just record a movement that is just played back without being integrated into the world.
I absolutely love how confidently the agent fails, full commitment to breaking their spine on the ground!
Imagine, Boston Dynamics roboters with this technology. What a time to be alive (for now)
I think it is the same technology. It's machine learning right? Neural network based training?
@@user-ik8vy1rg8f yea it’s the same thing. They also use machine learning, so they will do something like show them how to do a course and it will do it. But it needs to learn how to keep its balance and everything else which it will learn through trial and error.
(For now) XD
Tesla bot will try this before them .
@@xxbatman69xx98 I've heard that they mostly don't use machine learning, and not much is known at all
Although they may be working on that at the moment
This is taunting me as I learn body mechanics in animation. By the time I can do it well, we'll have the 'animate' button
Switch "well" for "we'll" so that you don't confuse even people who don't care about grammar.
If you want to level it up again, put a comma right after "it". That will be even less confusing.
i suspect you said this as a joke but i think it should be a genuine concern tbh. make sure youre not investing your efforts into an industry thats going to vanish in a decade
There's no replacement for personal expression! :) no machine can animate like you personally animate, or even you in a particular mood or day.
I'm sure you know that, just wanted to say it, keep it up animation is awesome, it's really cool that you're doing it.
P3ople have said that stuff years ago sooo
Can't believe how Freeza got beaten so easily. WOW!
Video games with next gen AI are gonna be fire!
That’s because they took off his tail
You must have missed Trunks' intro in the Cell Saga
3:07 I wish I was cursed with that crazy configuration 😏
Haha hey there DoodleChaos! Love your vids =D
god
乇乂ㄒ尺卂ㄒ卄丨匚匚 configuration
I had that long leg / long arm configuration too. But my motor skills were buggy as hell and it had strength issues too. Fortunately there was a patch that increased the thickness of legs / arms too. That fixed the strength issues and my body runs much better now. But my motor skills are still shitting the bed during sports. 😂
pixar moms
Holy crap, I've never seen such an explosive punch animated before. Not even motion capture can quite get to that level because the animation often does not translate to the physics of the game.
I’m loving the pace of AI! I’m just starting off at college and with some influence from your videos I have decided to pursue a career in machine learning! You make such excellent work and I feel so inspired every time you post!
*(Watching two minute papers fills you with determination)
This paper keeps jumping all over the place, lovin' it !
😋 Narf!
Too true! I would have to classify the paper as a "technological leap". ;)
I would love to have a video game where the character’s movement was determined by this AI so that as you progressed through the game the AI would slowly get better at the characters move set. By the end of the game you would be able to pull off moves that would have been unthinkable at the start of the game.
Amazing! I won't be surprised if in a few years we will have AI-based workout apps that suggest highly customized exercises based on your body type and body mechanics. Indeed, what a time to be alive!
Yes
Woahhh, this would be an incredible use for it.
I was also thinking it could be used as a way for Olympic athletes to hone their techniques.
Makes no sense
Machine: “jump higher”
You: “how?”
Machine: *plays video of sim jumping over a sky scraper
“It is possible”
You: *weak, sad, shuddering
yes, master.
Is no one going to comment about the fact that it looks like the model broke one of its ankles after every running jump?
I think that’s it’s “rebalancing” after the jump but it just does it very poorly.
It's because the before and after movement isn't being optimized simply the jump is. If the walking/running action were optimized it would probably get rid of that
@@mnomadvfx honestly I don’t know much about ai. But after seeing ai made in mine craft more complex then this it kinda degrades the fascination. And people’s are comparing this to boston dynamics is hilarious. Boston dynamics, besides for industrial use and military is the best quality you can compare to. And it’s not even there.
@@historyZZ you should've stopped after the first sentence lol
@@bukpuki please explain how ai on a software is more fascinating then the software on real life robotics?
Trivia - The first sport to be incorporated into the AI-lympics was the high jump.
😄👍👍
The day it figures out the Fosbury Flop by itself is the day I believe AI can do anything.
@@emperorsascharoni9577 That was the first thing that came to my mind when the wall was raised! Either it hasn't figured it out yet, which is kind of weird as there have been papers earlier where virtual agents adjust their limb & joint configurations to most efficiently tread a terrain - OR - it's possible there's some sort of rule in place for it to preserve the vertical orientation throughout the movement. But, yeah, figuring out the fosbury flop will make it a lot easier for it! That'd be so dope!
I love the humor! keep up the amazing work, I've been following for years and I still click on every video!
I feel that in the future, this is how characters will be animated.
Exploration like this is what could help AIs play games too, refining independent tasks and not just trying to achieve a high score in a long run
Not all games even have scores. And the AI that plays old Atari games can finish those, too.
@@davidwuhrer6704 I was referring to the fitness function in neural networks for playing
Do you notice the walking motion after the jump is very awkward? It seems to be dragging its legs forward with stiff ankles
Notably that awkward walking motion was already in the reference! So it probably learned that and had no reason to "unlearn" it (i.e. its presence didn't affect the fitness function).
I got sad for the AI hurting its ankle each jump
Yup, to me, the biomechanics seems wrong for humans but adequate for manikins being simulated by AI.
Probably because the bot is devoid of pain sensors and it's bones and joints are indestructible, so there's no need to improve landing posture to minimize negative impact on bone and joint integrity.
I thought it was going to spontaneously re-invent the Fosbury flop. No such luck.
I think here was a previous AI that did it. This one was specifically told to use the same move.
I can imagine this being used for movies, animations and even games where characters learn new moves while playing! That sounds like such a amazing thing. I'm excited for the future.
A game in which the player character improves movement over time would be amazing.
In Assasins' Creed, the player avatar adjusts movement to the environment, but it is pre-captured motions stitched together.
In GTA San Andreas, the player avatar can change its body shape depending on food and exercise. This then changes jump height, running speed, lung capacity, and how many hit points a punch subtracts from the target.
I'm thinking a game in which the player avatar acquires new ways to adjust movement to the environment and to changing body shape would be quire exciting.
A completely different thing would be AI agents learning movements from each other. There are many possible gaits, for example, which could propagate as memes through a population. I'm not sure how to make a game idea out of it, and it would be a lot more computation intensive, but I think the concept has potential.
Is there a channel dedicated just for this content? It's incredible watching this evolve!
This is honestly so incredible. Very useful for video game devs! Imagine, each pixel used to have to be colored in, per frame, then we got into 3D, but every single move had to be precision placed by an animator, and now and into the future, the AI will just do it all for us. We say do X, AI will do X in 1 trillion different ways. I love it. I absolutely love it all. Thank you yet again for an awesome presentation of what's going on in these fields, Two Minute Papers. :)
Sometimes the world is too much but this channel always makes me happy to be on the planet regardless of what's falling apart.
2:04 including phasing through solid blocks
...or go full Mike Tyson on the opponent 😂
Bite off an ear?
That's very similar to what Mike Tyson does actually, look at what it does with its legs and compare it with Mike. Crazy!
It would be very cool if a model would also predict its own risk of failure, and decide "I'm not going to make this jump, so I'm not going to try".
that jump on 0.3 gravity looks so happy.
This is the best thing I've seen in my life! This AI opens so many possibilities!
I just love this man's voice he is so cool!
I love your channel so much, I’ve been watching your videos for months and haven’t even started college yet
Would it be possible to develop a bot that boxes like Tyson at his peak, another that boxes like Ali at his peak, and set them against each other to see who would win?
I can imagine people actually having boxing matches with different trained AI. Maybe WWE AI as well. Would be dope.
Yeah
I guess, but you wouldn't know the specific preparation and strategy each would apply, or the plans each would have. There simply isn't enough data to understand that, particularly if you are trying to hit a specific moment in their career.
It'd be so cool if everything on this channel was somehow implemented into 1 game.
Like, a full game with realistic physics, ai optimized graphics, ai character movement.
This is a very interesting future we're moving into.
I'm gonna have to read about this. Hopefully it's good enough to run in real time because I'd love to see this stuff put to work in making a video game where the main character moves much more fluidly.
I think it is, they control it with a controller at some point.
first time me attending your video uploaded 1 minute ago, cheer up Doc!
I wanna see 2 AIs fighting each other. That would be insane.
2:22 - I would absolutely LOVE to see an AI fail video! It's always so hilarious to see these little failures, pure physical comedy gold!
Poor guy looks like he did a hammy after the first jump
Interesting how the model character slows down before each obstacle. A human would use his/her momentum with anticipation for the next hurdle as soon as the previous one was complete.. The AI bot seems to rely on her muscular structure and close-up evaluation of each block. I would suggest adding to her programming the ability to analyze from more of a distance or to analyze the entire course before she begins her movements.
this is what the game Indurstry needs and not fancy graphics! I love these kind of paper!
IMO, it needs neither, games are about entertainment, not realism, it's not like we can't do smarter AI for games, we just decide not to because it wouldn't be fun
@@geli95us games like gta would 100% be improved by having this because it wouldnt constrain u to just a few ways of hitting and breaking cars you could choose 1000s of different animations or even train the thing yourself you would have more climbing things like that
Is this impressive? Yes. Yes, it is.
Once I played PONG on our TV back in the 70's or so. Who would ever believe back then we could get to this level.......................
Supper COOL.
Isaac Asimov, that's who.
Of course hardly anyone believe him back then.
Move over, Boston Dynamics Atlas. There's a new kid on the blocks.
The perfect quintessential 2 minute paper video I love this channel so muuiuacacajajja!!!!!
0:42 1:07 oh gosh, the left leg's limping though
2:17 geez, it's suppper prominent and beyond the scope that i can ignore it
00:54 When he said "hold on to your papers" I was expecting the figure to have demonstrated convergent evolution and used the Fosbury flop!
"..but, do you know what else it can deal with?" obviously our sponsor... oh ohh.. "hold on to the paper, squeeze it"
I really love how u present these papers man; idk- don't ask me to describe it
u are just amazing sir...in the most geeky (in a good way) one can possibly say
ty for capturing the excitement in the most appropriate way- bravo
Ah i always love machine learning and seeing them adapt to different situations
i like how in the first video after the jump it walks like if it had hurted
Next step : Put this class of algorithms in the brain of Boston Dynamics' robots
Imagine a game similar to this, and with your skill level raises the pa(Procedural animation)'s capabilities. like without a level you can do basic jumps, climb things, etc.. but with a higher level you can do all kinds of different jumps, vaults, and swings.
Now stick this into Disney's robot aerialist.
Boston Dynamics wants to know your location with Bags of CAsh .
Hopefully they'll be able to compute the failure consequence in the movements to hopefully offshoot some of the damaging effects, but then again that could limit some of the requirements suggested to make a successful climb indefinitely beyond certain generations.
this reminds me of the baymax movie where the kid teaches his robot to do things
Does this mean that once we have 'perfect' simulations of our environments and robots, the AI robotic coordination problem can be sufficiently solved, and then transferred to the real-world robots?
Image self-play for hand-to-hand combat....
"Image self-play for hand-to-hand combat...."
Imagine the viruses and hacks in that scenario...
@@egdm1235 Lol I would have figured the humanoids would have been constrained to their emulated environment, but never considered the possibility to 'break out' of their bounds haha that would be a mess!
Ngl between "self-play" and "hand-to-hand" my mind went far from combat.
..Still, same issues with uh.. viruses, yes.
@@egdm1235 What if we just don't install a web browser on those things?
Remote code injection is considered a bug in every piece of software except in web browsers, where it is a feature somehow.
This is pretty much what they're doing with self-driving in Tesla and it is working extremely well. So yes, eventually you will have a humanoid robot that will learn through simulations and be almost perfect in execution in real life.
Really interesting to see its applications in the future
This is really cool, well done guys who made this! Well done!!!
thanks for putting subtitles so i can watch your videos.
Dear fellow scholars,
This is Too Many Humans, with Károly Zsolnai-Fehér. Wow! What a time to be simulated!
What a time to be AI!
Mind backups, when?
3:19
"Baby Legs, here we go!"
[Baby Legs makes whirring noises]
"That’s the sound I make when I’m trying to run fast."
― Baby Legs Detective (Rick and Morty)
4:24 - I love that WHEEEEEEEE pose, lol!
Changing body proportion is interesting, but how about just one arm longer or one leg slightly shorter instead of both?
...Would it still be able to cartwheel or do the other tasks?
probably yes, each one has its movements calculated individually, just like the legs. This categorization of arms and legs for an AI is more a human concept than an actual code thing
It just keeps Getting Better!
This is seriously next level for gaming! And T-1000s.
Kidding aside, it's so strange of a notion that character movement won't soon be "hard coded", but only a single DL model.
Don't you mean T-800s?
Huh, now I wonder how a T-1000 or a T-X would fare against a Transformer from Cybertron. Second Variety has nothing on them.
It's learns like a human with no physical limits
Did you guys catch that low gravity jump at 4:26? You could use this to predict realistic motions for people on the Moon or Mars. I'd love to see a sci fi that does this. You could do their everyday motions, sports, ballet, martial arts, really conveying that "this isn't earth anymore" feeling.
You can imagine in the future - boxing AI vs AI or maybe AI (in a physical form) vs humans.. We are going to learn so much from AI
2:01 It's so funny, I can't stop watching.
How fast does this simulation run? Can this AI be used to control / animate NPC's in a video game?
Not in real time I assume
Now i'm dreaming to 3d print a full body robot in real life and have the IA takes the control of the body ! 👌😆
After chess, go and starcraft I'm seeing the first human-robot mma fight approaching.
Today I learned that Professor's name is spelled - Károly Zsolnai-Fehér
.
I'm addicted to your voice. Absolutly amazing.
The best statistics channel on YT :D
as a 3D artist and animator this papers amaze me so much, what a time to be alive!
Absolutely incredible! What a time to be alive!
Let's just hope this technology is used for good in video games rather than the real world. What a time to be alive, for now!
Why shouldn't it be used in the real world? Parkour robots would be amazing. Boston Dynamisc is already doing something similar with robots intended for elderly care, which in an aging demographic is desperately needed.
1:16 I was expecting it to switch to the actual high jump technique used in track
Boston Dynamics: 📝👀 mmmmm interesting "AI punch"
I call it intelligent when it switches over to doing a Fosbury Flop at a certain height :-)
So... you're basically saying you think it will be a success when it... flops? ;)
if they can do this in a virtual landscape ...doesn't seem like much of a leap to transfer to a physical one
Great video. Thank you!
This would be great for npcs in games that don’t have a predetermined path to follow
YAH I LOVE THE DOCTOR I AM HOLDING ONTO MY PAPERS.
Thanks for the disclaimer. That is ethical. As always awesome videos.
When is this coming to Unreal Engine 5? Seriously..
Only a few years after it becomes available in Blender.
3:18 this scp has breach its containment
My favourite paper the AI stuntman!
4:24 is hilarious!
assassin's creed
tekken
and much more.
what a time to be alive :)
What a time to be alive.
these videos are so mind blowing. It's amazing how much AI can learn and how human-like it is. Now I see how some people are scared of AI in the future.
Git rekt
@@USBEN. I don't understand.
It would be very fun to put the AI in a superhuman body and watch it do insane moves
I imagine that being soo cool to have in games.. your character could realistically move as you created him .. and also adapt to the environment, man ..can't wait to see what future games look like :O!
Unreal has a system like this. Its already soo advanced.
It walks away after like it pulled its hamstring
Two papers down the line and we will be hooked to AI MMA
"This looks IMPASSABLE" 0:56 I see what you did there.
Congratz on the million followers