How to get better at video games, according to babies - Brian Christian
HTML-код
- Опубликовано: 1 ноя 2021
- Explore what happened when the AI system Deep Q Networks (DQN) attempted to beat the Atari game Montezuma’s Revenge.
--
In 2013, a group of researchers wanted to create an AI system that could beat every Atari game. They developed a system called Deep Q Networks (DQN) and less than two years later, it was superhuman. But there was one notable exception. When playing Montezuma’s Revenge, DQN couldn’t score a single point. What was it that made this game so vexingly difficult for AI? Brian Christian investigates.
Lesson by Brian Christian, directed by Gavin Edwards, Movult.
Support Our Non-Profit Mission
----------------------------------------------
Support us on Patreon: bit.ly/TEDEdPatreon
Check out our merch: bit.ly/TEDEDShop
----------------------------------------------
Connect With Us
----------------------------------------------
Sign up for our newsletter: bit.ly/TEDEdNewsletter
Follow us on Facebook: bit.ly/TEDEdFacebook
Find us on Twitter: bit.ly/TEDEdTwitter
Peep us on Instagram: bit.ly/TEDEdInstagram
----------------------------------------------
Keep Learning
----------------------------------------------
View full lesson: ed.ted.com/lessons/how-to-get...
Dig deeper with additional resources: ed.ted.com/lessons/how-to-get...
Check out our full book recommendation: shop.ed.ted.com/collections/t...
Animator's website: www.movult.com
----------------------------------------------
Thank you so much to our patrons for your support! Without you this video would not be possible! JY Kang, Abhishek Goel, Heidi Stolt, Christina Salvatore, Karlee Finch, Michael Goldberg, Denise A Pitts, Doug Henry, Keven Webb, Mihai Sandu, Deepak Iyer, Javid Gozalov, Kyanta Yap, Rebecca Reineke, William Biersdorf, Patricia Alves Panagides, Yvette Mocete, Cyrus Garay, Samuel Barbas, Brighteagle, LadyGeek, Curtis Light, Dianne Palomar, Marin Kovachev, Fahad Nasser Chowdhury, Penelope Misquitta, Hans Peng, Gaurav Mathur, Erik Biemans, Tony, Michelle, Katie and Josh Pedretti, Sunny Patel, Hoai Nam Tran, Stina Boberg, Kack-Kyun Kim, Michael Braun-Boghos, zjweele13, Jurjen Geleijn, Anna-Pitschna Kunz, Edla Paniguel, Thomas Mungavan, Jaron Blackburn, Venkat Venkatakrishnan, ReuniteKorea, Aaron Henson, Rohan Gupta, Begum Tutuncu, Mikhail Shkirev, Brian Richards, Cindy O. and Jørgen Østerpart.
If you’re interested in the problems facing AI and the movement to fix them, we highly recommend Brian Christian’s “The Alignment Problem.” Full of real-world stories and anecdotes that make the concepts graspable and immediate, you’ll learn not only about machine learning- but about human nature. Learn more here: bit.ly/AlignmentProblem
Gamers rise up
How about leaning something of actual significance! Banking, cooking, survival, food production a F-ing Trade. Create something that has never excited for someone eles to enjoy! Pfff
I want to create my own game
make a vid on how to get my dad back home, please.
#avax
"Bro just get good" - Sun Tzu, the art of war
"Train for another thousand years" - Napoleon Bonaparte
“Dance potato boy, dance”
- Julius Caesar
Hshahahaha
You spelled "git gud" wrong
@@Christopher-md7tf yeah and its "Sun tzu, the art of gaming" not art of war SMH
"Mute the Voice chat" - Tun Szu, The War of Art.
Best advice ever.
Pls don't pls talk
VC is crucial
the war of art*
😂
"If it's seen it all, why go anywhere?"
AI having an existential crisis, makes it more human, and a lot more scarier...
Exactly my thought, since the moment they introduced novelty I felt it was more human than machine, but when they said this I was in shock
It is very, very far from any real intelligence. The explanations in this video are more metaphorical than they are literal
@@jerry3790 exactly
@@jerry3790 They are simplistic versions of real things. The fact that our brain is doing a whole lot more doesn't mean it's not the same process happening. When a novelty based AI gets glued to a screen with lots of colorful images, it's not hard to imagine that a very similar system is causing the same reaction in children/people with attention disorders.
Naw, it gives it a reason to keep us around, just to see what nonsense we get up to next
"A novelty seeking system will eventually lose motivation"
*Me, stuck in college, feels attacked*
HMMMM
Pretty sure it was Sun Tzu who said that :-/
Bruh ur not alone
The idea for the AI to chase novelty instead of just points is really cool and probably the first step towards creating a depressed Robot. :D
oh my goodness. this so specific are you okay?
@@whalisten What? Yeah I'm fine, I'm talking to a Wall. But thanks for asking.
lol
Who cares it’s just a robot, therefore, none of the laws and rights for humans apply! It probably doesn’t FEEL anyways, just shows human-like behaviour. Well, at least, we hope. Because that would be very very convenient because then we don’t even have to feel guilty about anything. Legal, optimized slaves at last!
@@StillGamingTM Please don't compare sub-baby intelligence AIs playing Atari to slaves. It undermines actual slavery.
"Stop using my quotes" Sun Tzu, The art of War.
"He who quit mid-game, quit winning for the rest of his life."
- Albert Einstein, Expert Gamer.
Albert Einstein holds nothing on Hitler's KDR
@@unlimited8410 nah he go pacifist run thats why
@@farrel_ra I think Einstein and many other scientists help create the nuke, so... Support expert I guess?
@@doyourecognisethebodiesint9447 understandable
@@farrel_ra have a nice day
"Novelty seeking system will loose motivation"
Basically AI having mid life crisis and becoming a nihilist.
Nihilists can be at every age.
@@anhbayar11 ... Including mid-life.
So even AI doesn't like games that involve backtracking.
well, if you make the ai act like a human, it will act like a human
Smh, it needs to consider playing more roguelikes
Backtracking is really fun in a game when games make it rewarding. Meaningless backtracking is boring but meaningful one is not. Example of good backtracking is metroidvania games like Metroid and Hollow knight and roguelike games as well. I am pretty sure this ai will backtrack because it is meaningful for them to do. They will get reward for solving that puzzle by zig zagging around the world. It will remember the whole world and try to understand how his cause will effect the whole world. That's why a game having backtracking is much more difficult for ai but more rewarding.
Yeah
@@HerMi.T I literally quit Hollow Knight just because of the backtracking, it always felt so long and repetitive. But I agree that Metroid does it right.
Mom: Boy, stop playing games and do something beneficial. Watch Ted Ed for example
TedEd:☺
( ◜‿◝ )
Jeguro 😃😂😂😂
This is exactly what my mom says!
I honestly love Ted ed!
I never thought I’d be watching a Ted Ed video to get better at video games
Honestly a robot getting distracted by a tv is one of the funniest things I’ve heard in a while. Great video!
"Babies look at new things longer than they do at something they have seen before."
That is an amazing tidbit of information.
"Give a man tutorials, you give him fun"
"Give a man challenges, you give him skills and annoying teammates"
-Drip Szu
I am glad someone finally found a use for babies.
Paper weights.
@@psychopompous489 actually, any object can be a paper weight if it has some weight, so it's not a use for babies only.
Try again
@@Abdo-vo1gb The weight of what I do to the babies that refuse to serve their function can't hold down paper.
Check mate, atheist.
@@psychopompous489 I use them as checking how sharp the knif-
Oppsie
@@Luffy_wastaken Oopsie whoopsie
OMG so basically it did what a gamer would do. First run, you just goof around trying to see every piece of the world, try to do all side quests and whatnot and once you are comfortable enough to speedrun the game, you lose interest and throw it away. This just blew my mind
Im humbled to see even TED appreciating us Sweaty tryhards
"If it encounters, say, a television, it will freeze. The constant novel images are, essentially, paralysing."
Probably the most human-like behaviour of them all.
"A novelty seeking system will eventually lose motivation."
So that's why EA is not adding any kind of novelty to their FIFA games released every year, and that's also why the players are not losing their motivation to purchase the same game over and over.
“Go touch some grass” - Sun Tzu, The Art of War
Indeed
YES
Now I wanna toss a learning AI like that into a modern online match against real people and see what happens.
I think there's already an AI that's better at Dota 2 than any human
@@Christopher-md7tf I'm not sure if OP meant if the learning phase was against humans or if only the play phase was against humans.
The dota AI you are refering to trained years worth of games with/against itself before meeting the first human (that doesn't make it less amazing that the AI still is better at Dota 2 than humans)
They also used DeepMind against StarCraft2 players. And yes, DeepMind climbed the ladder.
@@Christopher-md7tf Open AI
It'll learn a bunch of slurs
4:18 dvd screensaver would have been perfect here
The fact that there is a Ted talk about this is 8-bit cool
AI: "man Montezuma's Revenge is so hard"
Baby: hold ma 🍼
Thank you TED-ED for giving this video. Thanks a lot !!!
"Simply obtain skill" - Sun Tzu, The Art of War
amazing animation, amazing lesson!! 🙌
Such a good video, thank you!
Great video and brilliant title. 🔥💪
"Hah! Pathetic, do better bruh"
‐Some guy who's definitely average height for the time
When they approach, we run
Away
@@AdvaitVaze oof yep there's a tax for that!
@@AdvaitVaze Sir, you're a genius
dude, uncool
You get a Porsche, you get a Porsche. You all get a Porsche.
Thanks for the video.
"I never said that" - Tun Szu, The art of War.
"Don't stop using my quotes" - Sun Tzu the art of war.
"Stop it, get some help!" ~Micheal Jordan
@@anhbayar11 " "Stop it, get some help!" ~Micheal Jordan " ~ Sun Tzu, The Art of Dunking.
"Toxicity no lose game, bad player do."
- Sun Tzu , The art of gaming
Is this from a neok video by chance?
I got the notof just after losing a bedwars game- the irony
Thanks bro
I also freeze in front of a TV. That was a very interesting video. Thank you
The animation is so good 😍😍
“The constant novel images” from the TV “are paralyzing”: they perfectly programmed in the mind of a 3 year old.
Again great video from TED
I really hope more games would appeal to our curiosity than to our greed. More games should make the reward a piece of knowledge about the game world, instead of "points".
I had a couple of eureka moments during this video. Good stuff.
Break the Game into Fundamentals.
Growth mindset.
Learn from mistakes/ learn from others gameplay and reaction
Set, and, Reward yourself when you hit a goal!
I never heard of Montezuma's revenge until now. that game looks interesting
Really good and interesting :)
"Just smash those buttons" - Art War, The Tzu of Sun.
"Git Gud" - Tun Szu, The Art of War
it is very nice ,thanks
Deep mind is a very interesting thing. I believe they have their own channel with some more in depth explanations. Very difficult to understand, but worth checking out if you’re into learning a bit more about AI.
Okay, but this is so cool. The fact that we can learn from AI just as much as it learns from us. It's all so exciting to me, and I am not even well versed in the field! Just the thought alone makes me excited!
Although I suppose being a Game Studies major does add to that excitement haha
That voice... I recognize that voice! It's the Demon of Reason!
Thank you for the tip TED-ED
I havrnt finished the vid yet and based on the title, i think this is going to be a rly interesting one
They instructed it to explore, I don't know if I should be disappointed, amazed or feeling self-conscious watching this video given the comparison.
You make awesome videos
The TV did hit hard...
Wow now even the babies are telling me to get gud
so, if society is based on exploration, it's harder to become depressed maybe. could be why pirates, cowboys, sci-fi and medieval fantasy can become so addictive. there is always something new to explore and the more you look the more you find
After watching this video my KD in apex legends went up! Thanks TEDEd!
Same here, its crazy !
Nice video.
This is so interesting
Now this is quality content
"The constant novel images are essentially paralyzing"
Yep that's youtube!
i just wanted the link so i could send it to my opponents in league of legends but this was actually a really interesting video.
bravo
Make it the ais goal to preserve as many human lives as possible and as comfortable as possible
Thanks for inform me..
2:17 Sounds like me trying to play any fighting game
This is so interesting. I never knew ai could be applied to video games
It feels like Ted Ed is always there so you will not get bored
Never thought I would see the a video like that.
The super fighters thumbnail 😂 👍
Wooahhh this is amazing.
Now lets put it against Dark Souls!
2:54 That's also true with baby/young mice; I don't have a lab but they always seem to explore my side of the room where I have just reorganized and leave the familiar and unchanged side of my room. They poop on the ground, almost like an indication of their presence and to my disgust. The years I have subconsciously follow their destruction and exploits, I have somewhat become a mouse researcher. My apartment has a mice infestation and my neighbors as well.
The most strange name ever appeared on my notification I clicked it anyways thank you ted-ed for the most random vid ever
thx
Cool stuff I will make sure to get better and push on!
I won't be surprised if the future Skynet uses the info in this video as a learning reference😅
It will figure on its own, it won't need this video
@@redemptivememelord6283 yeah yeah... But hey, my statement's just an "if"😅
Let's not be all "we humans, you machine" here; a lot of people don't know what's going on in videogame genres they haven't played, everyone gets videogame burnout, and screens are attention traps; you can't blame a machine for doing precisely what a person would do. Machine learning bias is not limited to prejudices; it also reflects our own tendencies. DQN is a great step towards real A.I. if they can get him to make a contextually funny and unscripted observational joke mid conversation and show cognitive empathy or learned empathy, the kind exhibited by well adjusted psychopaths, real A.I. can be achieved.
Raising a learning A.I. as you would a baby could be the way to achieve this goal.
Well adjusted psychopath it's a scary term 🤐
I swear TED-ED should be its own university.
This is just what I needed to watch 30 minutes before my finals exams.
Finally a video for me
In other words, the whole idea is based on the principle of "Pattern recognition" where the robot keep pushing keys randomly and record the "previous state (How things are)" and the result of the press. so when it again sees the same pattern ( the same shape, same circumstances, same state) it click the key that resulted good in the first time. in this case the robot needs constant feedback, that's why it fails with the long pattern because it lacks the instructions, nothing is recorded as good, but how they fixed it is a way of cheating. they could have a better solution
Mind blown
"baby tells me how to git gud." Sounds like the average Call of Duty online lobby
Great video! and Question: Why do we get headaches? -Shelby Quartuch
AI: You have the mind of a baby
BABY: You are just artificial
Finally, the perfect video to send my friends
Fun fact: montezuma's revenge is another name for traveller's diarrhea, spanish "invaders" were cursed by Montezuma II. with diarrhea. Yeah pretty funny
4:00 oh god, did it just get too real?!
Relatable bro-bot.
“Get good”
-All chat
“Git gud!” ~Hornet, Hollow Knight
This man just described my entire life with adhd
0:32 that right there kids, is a mother/earthbound reference
undertale reference 😳
DUDE!!!! As someone with ADHD(executive function deficit disorder) who struggles every waking hour with difficulties resulting from it, this was REALLY fun to watch.
If the goal of the AI is to learn to be able to play every atari game well on its own, why would the AI be forced to start playing right away without any crystalized intelligence i.e. fundamental knowledge like if a moving ball hits something, it will move to the negative direction of how it was moving...etc.,?
I thought before starting the training, programmers will surely DECIDE the range of how much of a basic knowledge the program should know before it starts trial and error to train itself(because to know "every" basic knowledge is not "efficient" for the purpose of getting good at the game. It "will" help but they should come up with limits) and make it remember it and use it while training.
If it really just dived right into playing games without any of that basic knowledge, I mean it's just like they did that for the sake of being "model-free"? Why be model-free anyways? No human is model-free. They just have accumulated enough basic knowledge to use in various different aspects of life through "long" time. - crystallized intelligence. So if you're making a game playing ai you should at least give it basic relevant knowledge like how physics work if you are going to make it interact with the physical engine.
And you don't have to teach it rocket science. But I know I want to just to see what it will come up with because it thinks so fast and it never rests.
I know very little about machine learning but I was under the impression that there are a tremendous amount of layers but they are essentially one or two groups. Maybe now they don't (I just read a book about it years ago I know nothing) but I think they can perform a lot more efficiently(resource-wise) if it had multiple groups of layers that do their thing so that the final product - action is the produce of emergent calculations.
Machine learning isn't the only approach to AI. There is logic as well, where an agent may carry out inferences over huge knowledge bases; and making such knowledge bases requires a lot of effort. Hence, approaches that require no or small knowledge to start with are very desirable.
That’s one interesting Cylon
You just need one thing:
*A very good gaming chair*
Yes
Something about gaming” - Sun Tzu, the Art of War