MarI/O - Machine Learning for Video Games
HTML-код
- Опубликовано: 12 июн 2015
- MarI/O is a program made of neural networks and genetic algorithms that kicks butt at Super Mario World.
Source Code: pastebin.com/ZZmSNaHX
"NEAT" Paper: nn.cs.utexas.edu/downloads/pap...
Some relevant Wikipedia links:
en.wikipedia.org/wiki/Neuroev...
en.wikipedia.org/wiki/Evoluti...
en.wikipedia.org/wiki/Artific...
BizHawk Emulator: tasvideos.org/BizHawk.html
SethBling Twitter: / sethbling
SethBling Twitch: / sethbling
SethBling Facebook: / sethbling
SethBling Website: sethbling.com
SethBling Shirts: sethbling.spreadshirt.com
Suggest Ideas: / sethblingsuggestions
Music at the end is Cipher by Kevin MacLeod 
Игры
That is downright fascinating. Makes me wish I went into programming.
You commented on this!
ur mom commented on this
Alan Becker program vs programmer? do i see a new video series in the near future?
MrKyleisawesome123 wtf is wrong with you lol
DragoonGaming MUST. HAPPEN.
This video was my first exposure to neural networks when I was in high school. Now I’m a machine learning engineer at Google.
Awesome
How long did It take to you and where did you start? Thank you
lie
Good for you
DOUBT
This video got me interested in neural networks for the first time. Now, I am living in my mom's basement having accomplished zero with my life since that point. My family says I am becoming a burden on them. Thanks SethBling!
me frfr
Thats also what my mother and doctor said the second i was born :]
For real, for real? No capitulation?
This video got me interested in neutral networks many years ago, and now I'm a software manager running one of the most AI centric teams at one of Europes largest companies! Thanks Sethbling!
That's awesome. Finally someone inspired by a game. I gave up long ago thinking that it was a waste of time. Now I am pursuing ML after finishing my civil engineering bachelor's.
wow epic
prove it
Can y dm me I'd love to talk dude
You have discord or facebook?? Live to talk to you about that
I started studying computer science 2015. I really never knew much about computer science. I started in the first semester with a programming course and came across this video and I was fascinated by this! Now in the last semester, I am writing my bachelorthesis in neural networks!
You were my inspiration!
please get an icon other than a white background
mediocre ice rink parodies... Why does it matter to u? Fuckin hippo
Yay! Welcome to the new age, Good luck!
@Dawson Harris this aint minecraft
I think my creator that wrote me to be an A.I. ChatBot had a similar inspiration ? :-)
I like how the fittest generation figured out spin jumping is the safest option because it kills most things it lands on or touches. Good job skynet
and things that it can't kill usually you will just bounce off of harmlessly
Kevinofrepublic fucking mental
Ah yes very good observation!
5 more neurons left for Mario to hop out the screen like the movie The Ring
so how to make code like this? what programming language is this?
A year ago I used this video to explain to my class what artificial intelligence was (or something like that, I don't remember) since I live in Mexico I had to translate and explain everything. Thanks for the video :) I learned, my classmates were entertained and I gave my teacher a good impression
@MySonNarkoman good point.
@MySonNarkoman I'd assume it tried various inputs, including those that didn't exist, until it found ones that actually did something.
De donde eres bro
Ah perro
chido man, si de seguro los dejaste inpresionados y fue interesante con el ejemplo del mario
Revisiting this video today. This the video that got me into AI. I'm a Deep Learning Engineer today. Thanks, SethBling. Cheers!
Pretty Cool. I'm looking to get into Machine Learning too.
hey, i started workin on my bachelors thesis and the topic is "Using artificial intelligence to discover new speedrun strategies" is there any chance i could talk to you so i could learn something?
This video I saw back when it launched and it made me want to go into programming. Finally, 6 years later, I am a senior Computer Science and Data Science double major who is quite literally learning about Neural Networks for the first time today in my Machine Learning class. Great video even today!
@@ShakeMe158 I love the concept for your thesis btw!
@@TheLegendOfLame yeah, i wish i picked a different one lol, im kinda lost
Absolutely amazing! I love how you explained this!
hey ant!
Hiii
***** Hey ant! I'm with Awsome Batz!
indiesoftgaming dafuq
The guy you saw at the mall today Well that's good to hear. The sooner you move on from you-tubers like him, the sooner you can find decent, more mature content providers.
That's pretty NEAT
+Angelo Christo No, there! --------> Pun
Neat pun
Im scared now
I'll answer your question- you have to go to MACHINE-ama and watch this video about learning for Video Games
+Marmori Pelaa :o Neature Walk
This video got me into neural networks. Today I'm a PhD candidate on neuromorphic hardware. Thanks SethBling!
this video is what got me interested in neural networks. from here I started reading further into it, got intimidated, and gave up on the spot.
I guess that’s as far as that evolution part of you got lol. Can’t blame ya there.
When are we going to see MarI/O do a credits warp?
Daveyard Holy shit that would be amazing
The Turquoise run it for some years on multiple computers and it will figure it out....
Daveyard if you gave it specific objectives or showed the program it might be able to do that, but you'd have to make mar1/0 play through numerous levels first, and it would have to understand that winning the entirety of the game is worth a massive amount of fitness
CRIMAFUYT Well, depending on how Seth made it, the program could learn that by going back to lose some fitness, it might be able to later gain much more fitness.
Of course, Sethbling can do anything.
First Super Mario World
THEN THE WORLD
***** but eventually it will realise that it is endless, and will know when to stop
***** like i said
it will find out that it cannot fully kill it, so it will move on
xET3RNALx xEVOx Humans still haven't figured that out and we've been running a lot longer
disreprivalize wait what
xET3RNALx xEVOx using armor stands
This was everyone's inspiration for learning ML
I guess it was for me, lol.
yeah
It was for me!
Absolutely
You are so right
Let’s see if Mar/IO can complete the full game Live on RUclips.
MarI/O
look at luigi/o
Wubulubadubdub!
I know cheeri/O can
It would take days/months to train on each level.
Then one day Mario became aware he existed… that day was known as judgment day
the 1k people who disliked the vid were the first few generations of MarI/O. they didn't know the difference between a like and a dislike.
EDIT: HOLY CRAP 1.4K LIKES!!!
I laughed a little too hard at this xD
nerd humour, sad
Four4 ok
haaaaaaaaa
No were afraid of a robot uprising
This is one of the first algorithms and videos that inspired my to get into machine learning. I now have written a couple algorithms and have my first pull request for Tensorflow. Thanks Seth!
This used to blow my mind. Now, these are everywhere and more advanced than ever. Technology has improves so fast I can’t believe it.
0/10 No armor stands
McDanny420 lol
McDanny420 xDDDDDDDDDDDDDDDD
LOOOOOL
"What if you used 100% of your brain at once?"
That's called a seizure.
lol
🤣🤣🤣🤣🤣🤣
Overclocking your brain
@Bold One ... but the algorithm learn by itself... In the beginning it didn't even move.
@@icarue993 It had to be given the instruction that if it sits still too long, it has entered a failed state.
I've watched this video when it originally released, and now I understand way more things. The explanation is very clear. Great work on this plugin!
Hey seth! I'm currently studying machine learning and just want to thank you for being my inspiration of sorts when I first saw this video. Really interesting video and well done for creating it!
I remember seeing an AI learning to play different NES games a while back.
One of them was Tetris, and the AI - because of the way it operated - just kept throwing blocks down without moving them, and right before the last block locked in - which would have caused a Game Over - the AI paused the game and then refused to do any further input, as if it had ragequit the game.
Bright Spark Yeah! There were two programs that worked together called Learnfun and Playfun, the videos are by a guy called suckerpinch and it is extremely intersting to watch
Bright Spark I was thinking of that Vsauce episode when I watched it too lol.
Real AI don't exist yet...
That was learnfun which learned a little differently from MarI/O
Bright Spark vsauce
And this is the prequel to Terminator
LOL
+Lyfe Slap Maybe..This could also be how Hal from the movie "2001" A Space Odyssey" evolved.
This was the first video that got me into neural networks. I've made several AIs that played games based on the method used in this video. Thank you so much Sethbling!
come back to this video once every year and it still impresses me
HI GUYS! SETHBLING HERE! TODAY I RECREATED EVOLUTION TO BREED A SPECIES THAT PLAYS MARIO. THANKS FOR WATCHING!
Fraktallity - Fifa 15 Videos *Cipher plays*
TheMCDuck 2016 Using armor stands
Welcome back, SethBling here.
Today I made minecraft inside minecraft using armor stands, so you can minecraft while you minecraft while you minecraft!
That's about it, thanks for watching!
Yo dawg, I heard you like Minecraft, so I built Minecraft inside Minecraft so you can build while you build!
( ͡° ͜ʖ ͡°)
Now make it play Dark Souls.
that would be fun
12357 try's later it gets past boss two
+Golden Clam Still better than me :D
Yes but it requieres more controls and more varibles
+Mr NubSkrub Yeah, especially because it would need to navigate through a 3D level. It would probably very complicated to make the "readings" in a 3D environment based on the camera view but it could probably manage it.
Idea, make it play GTA 5, see what happens.
Man, I miss the MarI/O streams. They were great to just chill for a while.
Thanks for providing the source code and the paper! Really appreciated it
When a game has no cheats and you know how to program.
Kandriod lmao Trueeee
By the time it figure out a way to beat the level you'll ne halfway into the game progression.
Jean Mathieu Lepage
But what's it learns how to beat the level though I think it would get to the end of the game before you.
And the time you need to code this shit?
Kandriod WOAH TECHNOLOGY
Today: Mario stage.
Tomorrow: Skynet
>kek
piff
next week: the world
In 2 days: get some milk
milk is rape
SethBling will make a sentient being using Mario World code injection lol, this whole stuff is super amazing, love it :D
Few year back i watched this video as a newbie student and it give me a motivation to pursue AI as my career. Now, I'm writing my Master thesis and will soon join a company as Machine Learning Engineer. Revising this video feels so nostalgic. Thanks SethBling. Kudos :D
4:55
I understand completely what Seth is saying.
Yup. Totally.
+Finn Else-McCormick i actualy realy understand XD
Formal Cat
Everyone can be smart if they want to. It's a choice. Noone is born smart. :)
+MasterGamingForever Yet you can't spell really right.
Probably from america if you can't spell lmao
ManyAlpacasYT
bulgaria
As someone studying Computer Science, this was great, thanks lad :)
thenthapple lol you're the guy who makes legend about fallout and some fallout things right?
Eren Mortel aye :)
thenthapple I would like to see it try ttt (trouble in terrorist town) Would be pretty cool to see what it does.
Ckinsman or a more reasonable game, cloudstone
thenthapple Black hhhg nc vjhc:frryhhjjjhhvz tb knjjbv gym
jbjjjj
That was amazing! I'm sure you have had fun doing this. Nice job!
This is by far the best video I've seen in this year. Tks
So, now that we have games that play themselves, we only need to rig a chatbot to comment on the gameplay. Et voila, the first automatic let's player.
Now to find something to replace the human viewers.
Something close to that already exists: watch?v=Qhh0igzqtqY
This is a video about a game commentator AI commentating PUBG gameplay.
A Box I laughed far too hard when I entered the link
The last part is solved, bots that 'watch' ads.
so sad ur mad
imagine what will be possible in let's say 50 years: an AI that can beat Dark Souls
Interesting stuff.
Phew. Blown away. Even with the process simplified like this, I am still struggling to conceive the actual coding involved.
Wow. Totally cool. Really interesting!
Steve Dowe HINT: Look at the source
Thanks Albert Zhang - I didn't realise it was open source.
haha. Always got to look in the description :p. Pretty obvious considering this is Sethbling. I don't assume he'll make any money off of this anyways.
(outside of youtube views)
This video was part of my inspiration to begin pursuing machine learning 5 years ago, thank you SethBling!
Have u mastered the subject?
@@abhijithbinoy875 I know enough to do useful things. 'Mastered' is hard to define
Absolutely Amazing. thank you for the visual representation of the neural network.
The game's playing itself, Jon.
I guess this is pretty neat.
Killermy3 Ba dum tsss
Get out.
+Killermy3 dammit, i was beaten to it by months! that's what i get for arriving late.
Anyone else see the glitches item box?
+Christian Evrard yes
Very intresting and well doumented video.
Also that outro, nostalgic
that 4:04 numbers is so beautiful. just to think and imagine how many millions of Input and Output (of the function) the original data sets of numbers has to go through for that 'neat' algorithm. Great project man.
Better algorithm than RUclips's.
yeah, much much better
heh
Truth
Well try to make worse
And yet, here you are.
This guy's pretty damn good for someone who's deaf and colourblind.
lol
what?
He's referring to the AI, since it can see the different threats only as identical black squares.
zsdfasdfas ah okay
Car Of Doom THAT DEAF DUMB AND BLIND KID, SURE PLAYS A MEAN MARIO
This video is so useful it was literally used in one of my CompSci lectures - well done
Impressive stuff, I'm taking a real liking to Machine Learning the more I see where it can be applied and what it can do.
Random mutations oh boi didn't expect that, they sure make great stuff this last decade.
Holy crap Seth, this is insane lol
If I wanted to teach myself how to do something like this, where would I start?
TensorFlow
can the ai apply what it learned towards beating the other levels now?
if the elements of the level are the same yes it can
This implementation is very specific for this level (overfitting), therefore so it needs to be retrained for every level.
No. Since it can only differentiate blocks it can stand on it has no real way to recognize a threat other than by running into it a few times. So this would allow each evolution to only be applicable to one level
hepotitus ah good point, my bad.
DarkaGamer A GAME THEORY, thanks for watching.
Friend, one of the most incredible things I've seen in the last few days. Are you crazy. If you adapt that language to another purpose, wow! Amazing. Congratulations
Still one of the most interesting Mario/Machine videos I’ve watched here.
Well now we know how machines will destroy humans!
MrChipelo but it will need some trys to learn how to do it first :p
MrChipelo By... jumping on their heads?
MrChipelo Dont worrie, the machines will walk against walls a couple generations long before they figure out how to aim and shot at people :P
TheZapDude that would work...
MrChipelo Yeah it'll take 1000s of generations of robots to kill us but yeah thats how we die.
Is it possible to let it keep evolving until it can beat the whole game?
Samuel Nielson I mean is it possible to do with the current processing power we have?
Generic Username yes it is. and when it starts to learn it will be faster to learn more after some point.
Generic Username Set it up to twitch and leave it running. people will pay for your electricity bills
willky flame I would if I knew how.
TheHiroo17 Then we need to change how his fitness works.
Thanks for getting me interested into neural networks
the og random yt recommendation about ai
weird to see how things changed in less than 10 years
Are there any other videos of people doing things similar to this? I'd like to see more of it. Maybe in a year or two, someone could secretly shove a bot like this into TF2 servers.
It would be a lot harder. But possible.
COYADD Idk..I imagine that if there were, it would probably say something like, "How about a nice game of chess?
This evolution might take thousands of years. Adapting to never changing environment is one thing - adapting to intelligent humans, who've been evolving very, very long is so much more complicated.
Егор Цебро I like pancakes.
Ben Warters Nope. I don't need nerds that don't know the difference between "joke" and "reference"
Now try it out on Kaizo mario.
could take years
+HG | Meta It will take like a million generations before it can beat a Kaizo level hahahaha
CoTeCiOtm Yup.
+HG | Meta Will take forever, but it will be possible.
That will likely take at least 5 days to learn.
Machine learning is fascinating! So many applications! I need to learn it.
This is the video that got me into Machine Learning. Thanks for inspiring me @SethBling
I wanna do something really stupid. Create a bot like this for CS:GO
how is that stupid lmao
You can get pretty much everything you said from memory reading. Player position, health, enemy position health, view angles, enemy view angles, pretty much everything is stored in memory. :)
Source: Thats how aimbots are made.
I dont have the knowledge & passion for making such.
***** We never mentioned anything about aimbot.
***** Because you randomly just talk about aimbot.
I still Cant get over how amazing this is
Your coding is really neat and satisfying to look over ngl
Excelente muestra de Machine Learning. La técnica de este programador fue la de 'Prueba y error', el algoritmo primero ejecuta pruebas y tomando en cuenta los puntos críticos, guarda el estado analiza las posibles acciones ante el estado crítico y vuelve a ejecutar la prueba con una acción en el punto crítico. En este caso la inteligencia aprende de los errores. Otro punto a considerar es que el algoritmo únicamente entiende la acción de saltar en el punto crítico, eso significa que no fue programado para acciones como frenar, detenerse, etc.
How many armor stands did this take to make?
Dashel Rubin-Stencel It's a joke T_T
Dashel Rubin-Stencel You really don't get jokes do ya bud?
pop1040
I've seen this joke like fifty times. I don't get it.
pop1040
I've seen this joke like fifty times. I don't get it.
now let's get real
*AgarI/O*
*slowly claps*
I wonder if this can work with something like Runescape for mining and such. I know there are better tools (bots) for that, but I wonder if it could work.
The Game Replay I have no doubt that it would always do genocide runs
So much this
No prob
In the future DEEPMIND can do this
//maybe :P
Really cool overview. Would love to learn more about how it works and was implemented.
I've been fascinated by this video for years now. This video got me interested in machine learning, which motivated me to start a masters in AI. Finally downloaded this algorithm and got it running, thanks for providing the source code!
how did you get it running? ive managed to get lua and bizhawk running but i havent been able to run the evolution program
@@charlieproffitt5809 Make a named state called DP1.state at the start of the level you want to run. Open the LUA Console in the tools tab and then Open the NEATEvolve script
@@rene-of3sc ive got it running, ill probably be able to get it working now thank you
"Hi Seth Bling here. Today I'll be showing you my time machine."
using armor stands
@@martinungar6146 and no redstone
Yesterday
@@reuben4721 in a 3x3 space
“Hi Seth Bling here. Today’s I’ll be showing you my time machine.”
Seth you should make a programming tutorial series
+CaptainAwesome I'd be awesome if he could make a tutorial about NEAT!!
+CaptainAwesome ya good idea
+Björn Wallden the resources on neat are kinda slim anyway
+CaptainAwesome And how about you learn it yourself?
+Mikiultima and how about you just shut the fuck up you little bitch?
That's preety awesome! After researching about AI and Navigation meshes, i now know more that will help me in my Blender projects!
I’m so happy I found your channel
Okay I think I got everything...
...but where do the armor stands go?
Welcome back Sethbling here, I've made Ultron!
this self improving neural network stuff is playing god, I love it.
But does it get salty? Because once that happens, humanity will perish.
Mark these words, that’s exactly what will happen. Keep updated with world news, especially today. Things are escalating, soon the volcano will blow & full disclosure will begin. A NEW AGE IS UPON HUMANITY 🙏🏽
@@Bunkabusta73 ok
Nah.
It'll buy a couple of puppies and sulk in the corner with the puppies.
That's what the AI that played the Stock Exchange game on NES did.
@@Bunkabusta73 I agree. A new age.
It will when it starts getting repeatedly softlocked and killed on pick-a-pipes on shitty Mario Maker 2 levels.
When seth goes from playing video games to making ai and nuronetworks
roses are red,
violets are blue,
there is always an AI,
better than you.
..and theres always a South Korean better than it.
Roses are red
famed mustachio
of Nintendo fame
ZA WARUDO.
Unless we're playing GO...
"Famed mustachio
Of Nintendo fame"
time to call the department of redundancy department
Altourus OOOOOOOOOOOH SHOTS FIRED!!!!!420
You inspired me and gave some idea about machine learning. Thank you, SethBling!
did you try this neural network on a new level to see how it would do ?
and im here failing to program a calculator
You can't program a calculator? What language are you using?
+isectoid maybe he's a beginner beginner? I started programming with python knowing nothing about programming.
***** I'm a c# noob. I was just wondering if I could help him out.
Gaiacarra Calculators aren't actually complex, but I see your point.
Other way around. Computers are just really complicated calculators.
Awesome work dude
The ChatGPT boom brought me back to this video after 7 years.
Is there a way to let MarI/O see the diffrence between a goomba,koopa,mushroom,...? can somone do this please?
la pregunta esta buena igualmente. tarado.
Over time, the neural network would be able to differentiate them by they way the enemies move & act (jumping, moving quickly, throwing projectiles, etc).
Citing this for a university report.. feels kinda strange writing "(SethBling, 2015)" XD
Welcome to the future! XD
Can I see that report? :)
thanks for sharing SethBling
Imma look at this video and see how much i know before the moment Id leave this comment to later on after learning about Reinforcement learning. Thank you posting it and it has inspired me to tackle on Reinforcement Learning. Id hope to add some model of my own version for video games a passion Id know ill stick with....
This might be selfish, but would you mind showing a version with greater differentiation between the green and red lines? This is super interesting, but I'm colorblind and most of the lines look the same to me.
Even if you can see the colors it still doesn't make much sense.
Lol yeah I see your problem but JustusBProductions is right
Daracaex If you look at it through the red part of those old 3D glasses, you can differentiate between them!
Ah, memories of watching BoxCar2D for endless hours of the night...
I still have a bookmark and leave it running some nights. Forcing 1 wheel on speedway makes some strange things
holy shit that's awesome!
I got a three wheeler in the first generation that rust drove off until it disappeared :OO
Bro this video is part of my Intro to Computer Science class at K-State, that's huge.
The video that got me into machine learning!
That moment when you have taken machine learning and A.I. courses, and you still have no idea how Seth was able to do this.
I'm afraid those courses might have been complete scams.
what the fuck dude. "welcome back, sethbling here, today i've made a robot revolution in our society out of command blocks."
This is a dream come true! haha Super Mario was my favorite game when I was a child!
8 years later and im seeing this on TikTok live
So, how many gen to beat kaizo mario? :D
Eaglegroove I shudder at that thought. it took 71 species for the program to learn to move right, I can't imagine how long it'll take for it to do kaizo lmao
Reaction time is instantaneous. There's no reason to make it play at normal speed. Could probably teach it in a few days if you run the games at a fast enough time multiplier.
For some kaizo marios like mario must die, there will need to be a very complicated fitness function.
200 probably
200? 200 wouldn't be enough to beat one Switch level