MariFlow - Self-Driving Mario Kart w/Recurrent Neural Network
HTML-код
- Опубликовано: 4 ноя 2017
- I trained a recurrent neural network to play Mario Kart human-style.
MariFlow Manual & Download: docs.google.com/document/d/1p...
Mushroom Cup: / 183296063
Flower Cup: / 183296268
Star Cup: / 183296400
SethBling Twitter: / sethbling
SethBling Twitch: / sethbling
SethBling Facebook: / sethbling
SethBling Website: sethbling.com
SethBling Shirts: sethbling.spreadshirt.com
Suggest Ideas: / sethblingsuggestions
Music at the end is Cipher by Kevin MacLeod 
Игры
Seth is trying to create a brain clone of himself so he can never really die.
+purplebootsgames I'd have this at my funeral as free merchandise for fans of my brain.
Welcome back, SethBling Reincarnation #4 here
SethDOS
One day you will be able to race Seth even though he's deader than a doornail
*THE RIDE NEVER ENDS*
"What is my purpose?"
"You try to mimick how I play in Mario Kart"
"...Oh my god"
mushroom taco lol
Poor lil' robot
That is why machines rose against mankind xD
mushroom taco That is a whole hack of a lot better than serving butter.
IM PICKLE RIIICK!!!!
A year ago I watched your MarI/O video and was exposed for the first time to neural networks. It was because of watching that video that I decided to take machine learning courses at my college. I am now pursuing a career in AI. Thanks so much!
The Modern Shoe ~ 👍
Similar story for me. I was focused on game design but I am switching courses around now to fit a machine learning path.
Rory Williams Wow, I am doing that too
@ 3:42
"I recorded 15 hours of training data."
Otherwise known as playing the game. xD
Gotta give props to him for having the patience to play a relatively boring game for 15 h.
@@sontapaa11jokulainen94 Can be done in small increments, say 20min one day and 2h the next day maybe 30min the 3rd day etc
@@thisflyingpotato4227 yeah but still playing 15 h of some crappy (for todays standards) racing game is hella boring
Quick! Someone train it on TAS data!
Kitty40 lol
Whats TAS
Kitty40 you'd think it would work well, but in reality, it would be even more prone to getting confused when seeing unfamiliar situations.
It would just memorize almost the entire tas perfectly, RNN's are very powerful structures.
actually I was going to start working on something like this. I'm going to target SMB3 and see what it can learn.
I've been wanting to get into neural networking just recently so a refresher video of you demonstrating some of the cool things we can do is an awesome inspiration! :D
If you're interested in learning more about neural networks, I highly recommend looking up "3blue1brown" on youtube and watching his videos about neural networks. It made my understanding of neural networks go way up!
Thanks for the recommendation!
LazerLord10 we
Same, I was just about to come down here and make my own comment suggesting the same thing.
For more interesting projects using neural networks I also recommend carykh
LazerLord10 thanks
Wow, the trade off play idea was pure genius! Did you set it up so you could override the networks commands at any time, or have control alternate back and forth at a regular interval? I love the idea of taking control and guiding the network, like you're a master painter guiding the hand of your apprentice...... so sick!! Amazing work!
I just had it switching at slightly random time intervals, because I didn't trust my reaction time to be fast enough to correct the errors as quickly as I wanted. So I was just always pressing the correct buttons, whether or not I had control (even though it was only recording my button presses when I was in control).
+SethBling I have no idea what either of you said but ok
They're talking about 4:27.
SethBling Nice! So, have you ever considered DefCon? Your content could be very interesting over there.
SethBling I thought that you had programmed it to relinquish inputting command when it detected input from an external controller
Love it. Keep up the good work SethBling!
Finally!!! More neural network videos! Keep it up SethBling, I love this stuff!
Miguel Ballard Agreed! Nothing I find more interesting really... you can apply them to an endless amount of problems!
*Dope*
*_Nope_*
666 likes original
I'd be interested to see how it would react to a speed runner training it.
this stuff is so incredibly cool! I love these videos!
These neural network videos are so good. Please make more!
... and behind this is a bunch of command blocks!
Don't forget about the armorstands
kek he doesnt do minecraft anymore though
and behind _that_ is an original joke
Behind your comment is where you'll find a mountain of salt.
Minecraftfan4 hes still having a Redstone channel picture though...
That idea to switch between NN and yourself was pretty clever . I'm often impressed by your creativity man !
Currently learning neural networks, and this is gold. Thank you !
You should probably get a github page going if you want to share source code? Much better interface than google docs :)
+orochimarujes
You should probably take a common sense lesson?
This is very cool! If you are looking for something pretty simple to try and tweak this with, adding convolutional layers prior to your LSTM layers seems tailor-made for this type of application. Chase those gold cups :)
Cipher
So glad you finally released the video on this!
Good that I watched the 3blue1brown videos so I understood something!
SpektralJo thx
Same! I was like, "I actually know some of these words and the math behind it"
Oh also the sigmoid, weight, layers, etc.
O sht a bro
Same
Great work on the Skynet-Basics ! Keep on with your work
So cool man! Great work!
Your projects are so cool!
This channel has had such a weird progression over the years. I love it
Really good, I'm personally working on a number recognizer so yeah, good video!
it was fun watching the videos in the background while I was working
Thank you Seth - this is a brilliant introduction to NNs!
Oh my, man, I love your neural network videos
This is amazing. Well done!
Professor just used this video in our class, super cool stuff.
Starting to find inspiration to get into this AI and Machine learning world. Awesome! Thanks for sharing!
Brilliant, as always. Thanks Seth.
As always this is so, so cool. lov u Seth. 👍
This is freaking awesome! Subbed!
Very cool, just subscribed!
I love your content to bits.
This was a great explanation! In case you want a more detailed version, 3Blue1Brown currently has a great series on that.
Great video and great job!!!
Jesus fucking christ dude, every video I see of yours is amazing. Love how smart you are my bro, keep up the good work.
I have no idea what's going on, but I'm thoroughly entertained
Lol you got me with Mr. Electric Mars.
Amazing! Keep up the great work.
I wonder how good it could get watching TAS runs
nailed the guess. i was staring ay the bottom left quadrant of gameplay from the start.
yesss another seth video
Amazing. As someone who just entered the world of Machine Learning, this video motivates me to become better and better at ML until I am also capable of creating NNs that can perform tasks like this.
lova ya work bro !
Super cool video!!
Holy fuck, what next, fully functioning Hal 9000 and GLaDOS? Seth, you're just making the world 1 step closer to being overtaken by robots, LOL. Loving these projects, keep up the good work! You need a patreon
Amazing! Thanks for sharing
And here I am just watching RUclips videos. I ain't even mad. Good job. :D
Great stuff!
Amazing mate
I like how this channel went from Minecraft videos to neural networks videos
Oh man, I've worked with neural networks and classification with statistical information before. Seeing stuff like this make me feel like my experience is equivalent to handing a monkey a picture of a corvette and expecting him to assemble one.
That is some seriously impressive stuff.
Your idea is awesome.
I got the notification for this video as I opened youtube.
GG
so last year. I did an essay for school on using neural networks for self-driving AI. and it failed miserably. both types of networks failed to go through a basic obstacle course. Spent a month's worth of time coding.
Now I found that every major organization + Sethbling have done it and they make it look easy.
amazing!
i bet the best part was actually playing and recording your gameplay.
So instead of learning from itself MariFlow learns from you? Neat
Just like giant_neural_network pointed out, I had to comment about the geniality of the trade off play. Amazing idea!
The man is back on RUclips!
Being in calculus now your videos make sm more sense
I just love SethBling's neutral voice xD
Would it be possible to train such a network with reinforcement learning instead of using recorded footage?
This video legitimately scooped a paper by a professor I was working with. "HG Dagger" uses the same idea of having a human take over control of an agent, and was published a year after this video
As someone who just started learning Tensorflow. This is awesome!
This brilliant!
Very cool, makes me think of markov chains and cybernetic feedback.
very nice! I am impressed.
I am now enamored with the idea of having a tournament where everyone brings their own trained AI and then they compete.
It'd be like an Amiibo tournament in SSB4, but for the Super Nintendo.
0:11 BEST joke ever, you got my like bro !
Did you consider using a generative adversarial network to generate more training data for the RNN? It would be interesting to compare the effect of that on the performance to the effect of using your trade off play idea.
Great Video
Great idea!
man that was so mind boggling
One word - *Astounding*
This sounds like a class project
Dude this is epic
This is the ultimate turing test!!
Welcome back sethbling here, today I will be curing cancer with Mario.
Around 4:50 , how do you make such interactive sessions? Do you have a switch button that switches from the model predicting buttons to start recording training data??
I know this is quite an advanced thing to ask but how would such things go with games like Doom or Duke 3d, or even the latest ones like Minecraft. Could you train NN on them as well or would it be to hard to do?
I swear to god this man is gonna make skynet and take over the world with robots who play mario kart
This is quite possibly the coolest shit in the entire world.
Dude are you some kind of Mario supergenius?
Definitely the best Minecraft youtuber out there
This is actually what I was wandering
What is the advantage of using memory cells instead of giving the last n frames as input instead? Is the memory cell method much less computationally expensive to learn? I would assume that using the memory cell method would also remove the need to estimating how many frames would be enough.
Hey again Seth. Looks like you have another mario neural network video.
Self driving cars are also the future of video games
this is amazing, honestly.
now make a neural network that can complete dark souls
90's : played mario for fun
10/20's : creating an algorithm to play mario for fun
Would this sort of neural network be applicable to more peripheral related devices? Like when a button press can make a huge difference how hard it is pressed, or how much x is tilted.
Sethbling you will be the reason that the world reaches the singularity
We seriously need a neural network mario kart tournament.
0:57 I knew it. I put my finger to the screen when I saw him skid around like that.