How I Taught an AI to Play Pokemon Emerald
HTML-код
- Опубликовано: 11 окт 2024
- In this video I go over the tools and techniques that I used to program an AI to play Pokemon Emerald!
Computerphile A* search video: • A* (A Star) Search Alg...
Sebastian Lague minimax search video: • Algorithms Explained -...
Blog / Transcript: remptongames.c...
Github: github.com/Rem...
![KSI - Thick Of It (feat. Trippie Redd) [Official Lyric Video]](http://i.ytimg.com/vi/tXEPbotEjZE/mqdefault.jpg)
Hey y'all, if you liked this video I have made a follow-up, which you can find here: ruclips.net/video/C1KpQc9cWmM/видео.html
This video focuses on AI for Pokemon Showdown, the competitive online Pokemon platform. I also answer several frequently asked questions about this video, and announce a possible future project! If you enjoyed this video you should definitely check it out!
Next video: AI critiques Pokémon artwork from the early 2000s
Being a long time Pokemon fan and a fairly recent AI engineer! I find this extremely awesome!!! Would love to collaborate to make the AI better!
Yeah do it!
Been a while since I got into using TAS software. But now that I know more about how reverse engineering files and looking into memory. I've been thinking about randomly generating the input directions for 24+ hrs. Running the directions at super fast speeds. Doing that a 10's of times.
Whichever gets the furthest, is the basis for the next generation and a slight mutation rate between the new sets of directions.
More or less, genetic machine learning. But since I want it to come up with its own strategies. So I think I want to only want to track gym badges. This will take an absurd batch size or direction length since it will be going in circles. But I have a feeling there are better glitchless strategies in speedruns. And I think this might find them. (Since TAS gets rid of RNG, I bet it won't withdraw the portion from the PC in 1st Gen. But maybe it'll find other things.)
Now teach A.I to play pokemon competitive (pokemon showdown)
I think there's actually a rule against that in Showdown.
pog
@Rotom Channel bro u don't know anything about competitive pokemon
@Rotom Channel I'm not salty I just don't know what format you would do that in unless ur talking about VGC maybe but I don't even think that
@Rotom Channel hey wanted to apologize for my comment. Before they banned zacian yeah just spamming behemoth blade worked in ubers mb. While like maybe click other coverage moves too but yeah
What would your Pokemon team look like if AI chose it.
Six magikarps
this is gonna blow up. calling it right now
Thanks, I’m glad you liked it! To me 4,000 views already feels like it has blown up haha. I’ve got a related project on the way in a few weeks as well!
@@RemptonGames thats so awesome to hear man! keep up the hard work. this is very good content. i look forward to your new project! :)
I was kinda hoping it was just gonna be a computer plowing through Pokemon Emerald, bumping into walls and catching like 3 of the same Pokemon but beating other trainers....that would've been funny
The work that went into this was crazy!
Check out codebullet
Just had this recommended. Was surprised when you said "small channel", legit thought this a big pokemon channel I haven't heard of.
this was very insightful, please more on machine learning/reinforcement learning, this deserves way more views!
Love your content! You deserve wayy more views
Holy crap. Watching the AI play the game live on Twitch would be super cool. Love the work that went into it.
I'd love to see a follow-up video about it and maybe see the AI battle system implemented, as well as overworld puzzles and gimmicks. I'm sure it'd be a big task to program all that and it would take a long time, so take your time if you do decide to continue the project.
This makes me wonder... would the AI go out of its way to catch Pokemon they deemed useful?
Based on the response I’ll probably do some follow-up videos, but they will take some time and I have some other stuff in the works. As for catching, I think the easiest way would be to basically follow Nuzlocke rules (catch first thing in a new area) or some other simple rule
I wish you had more subscribers. These videos are so professional!
i cant get enough of these programing videos crazy! good stuff
a little disappointed you didn't have the AI beat the whole game would love to see how that ended / was even possible ( i'd do it if i even knew how to write such a scipte )
It would probably just have a couple level 100 pokemon you catch early in the game
Here before this channel blows up!
Amazing quality stuff. :)
Thank you gods of the RUclips algorithm for leading me here!
Really nice and informative video! I liked your calm way of explaining things and as a fellow data scientist/machine learning person I'm intrigued to try and do something similar :)
Keep up the good work, looking forward to future content!
Nice video - im happy that i found your channel while still below 1k subs - cause this will change really quick!
the youtube algorithm gods has led me here. . Well edited, good audio and informative without being overwhelming. Have a like and subscribe sir.
this is so interesting, I would watch an hours long video about this!
Criminally underrated video. Excellent work.
With this quality of content I was shocked seeing your subcount lol
I see Eragon in the background, I leave a like!
Coding + Pokemon?
Loving this channel!
I'd really like to see a part 2 to this, continue the project! I'd like to see a reinforcement learning technique applied to pokemon, although I don't know how feasible it would be given the action space.
I have just recently circled back around to Pokémon. As a data scientist, I would want to find a way for the AI to learn from a play through and apply it to a subsequent play through or even another ROM. The cool thing would be to implement this learning in a manner that would be visible during gameplay
One idea I thought of is what if an AI go against a stronger AI as the pokemmo AI. That would be almost like AI wars.
Will be very interesting to have a complete set of Pokémon games that were completed by an AI. You can do one game for each generation. And you can challenge yourself to design the AI to have the game completed in the fastest time possible. Like some kind of weird but interesting to watch AI speed run.
In addition to the pathfinding limitations you mentioned like solving block puzzles, I would imagine that the basics of RPG questing wouldn't fit cleanly into A* search. I'm fuzzy on my Gen3 so if you'll excuse the Gen2 example, Mr. Pokemon. You grab your starter, venture past the first town, and find Mr Pokemon in a house in the middle of a route. So far so good, A* should eventually get you here. But then after getting the Mystery Egg, you're supposed to take that back to Prof Elm.
There's likely some flag in memory once you trigger a plot-essential conversation like this, though it'd be difficult to datamine this flag using the techniques you showed, and regardless, that flag wouldn't help you know where the next flag is located. Furthermore, the next step is to return to an area/NPC that A* already interacted with, because now the gamestate has been updated and this NPC does something he didn't previously do (accept the egg from you). I suppose a solution here would be that if A* exhausted all currently-accessible areas, then restart a fresh A* under the assumption that you must've triggered some event or obtained some key item, and that backtracking to old areas is warranted now? This feels pretty unoptimal, like you'd end up re-combing the entire world map every time the game requires backtracking, but I'm not sure how else you could make this smarter without hardcoding some quest knowledge into the AI (such as "if you have a Mystery Egg, give it to NPC #2 on map #0").
This is sick, man. You should be proud, man.
Really good video, congratulations!
Wow this is really cool.
I wonder how deep this rabbit hole can go., like learning and forgetting moves, or planning move synergy or game meta that a person is more likely to click with
like for example, how it would calculate an instance of rain and thunder, vs 2 instances of like shockwave or prioritizing certain types or the risk factor of catching certain pokemon or rather not catching them if the AI cares about money
Please for the love of god have a tournament of the best ai teams.
now i wanna see it complete the game
Genuinely good channel.
Now I’m wanting to make an AI for Pokémon!
This is my first vid and already like it keep uploading pls
Underrated RUclipsr!
This is such a cool project, and I have so many questions! How far the AI get into the game? Could it beat the puzzles? Could it think about its team and optimize? What starter pokemon did it pick? How did it navigate menus and choices! This is so cool!
Now, what we need is: AI Plays Pokémon VS Twitch Play Pokémon, and see who beats the game first
great video! and super fun topic!
Came here from Reddit.
This is so goodd!
Eragon on the bookshelf 👀
If you like this video I really recommend a video by pimanrules where he makes a ranking of the ai trainers in generation 1 by making them fight against each other it's really one of the best RUclips videos I've seen
Super interesting and very informative, let me know if your still interested in this project.
Finally someone other than me who says PoKEYmon
I would just be easier to preprogram where it walks then having it do this and paring that with a damage calcautor to pick the best move.
Do Ai tutorials , not many good channels out there
You should keep improving on the ai and let the ai run a 24hour livestream and when it beats the game it starts a newgame
Can't you look up GameShark codes to deduce which memory addresses represent which game attributes?
Interesting suggestion, I’ll have to look into it!
Nice work!
I would love to see an ai play the whole game
How did you integrate Emerald rom with GYM Retro? I'm having the worst time. I keep getting "No romfiles found for game" errors. I went through their integration guide, retro.readthedocs.io/en/latest/integration.html#game-integration, where im stuck at is the Using a Custom Integration from Python
section. I'm not entirely sure how to run that script listed. When I try I get , "name '__filename__' is not defined. Anything would help. Thanks!
what i did was manually add the 3 json files and rom.sha along with the rom and savestate (this needs to be zipped in gzip format) into a folder called PokemonEmeraldVersion-GbAdvance. For my windows installation using python 3.8.x this folder needs to be placed into C:\Users\{user}\AppData\Local\Programs\Python\Python38\Lib\site-packages
etro\data\stable you then need to either change the code to match your savestate name or rename your savestate to state5 for the ai to run on your machine. For me there integrated UI program did not work when trying to download it. I did find another download here: pythonrepo.com/repo/openai-retro-python-reinforcement-learning scroll down to the bottom of the page and you can find the different releases. however the release i tried to download would not play my copy of emerald. hope this helps in some way.
This is amazing - but please stop saying poke-EE-mon 😂❤️
Based on the way you constructed the pathfinding system for the AI I'm left wondering how it will manage in situations where the game forces you to back track to areas you already visited such as Norman's gym.
so many more problems like the puzzles lol, this would only work with it also spamming A on everything and walk through walls enabled
Have you tried using advanced map(Pokémon romhacking tool) for some of the data you lack (ex: map data)?
Hey, I'm trying to complete a similar goal and I've run into a speed bump installing the retro gym integration ui. It doesn't seem to exist anymore? Any idea where it went? I've hit a brick wall
What about moves like Leer that lowers the stats of your opponents? Would it consider those effects or would it exclusively use attacking moves.
A few questions. Is there any way to tell that AI racked up the score? I am interested in more videos like this. How do you think this might translate to more complicated games?
Can you do like a stream maybe of how long it takes your Ai to beat emerald?
The only real question is what Pokémon the AI used the master ball on.
This is Very interesting
So is it like the oldschool gamesharks?
Hello, what great content, could I somehow get in touch with you to be able to do this for myself, I would like to remunerate you
I wonder what would happen if you took an ai from pokemon reborn and dropped it into pokemon bw2
Wow less than 1000 subs! I'll click!
Love!
don't know if you did this but can you post this so someone can ran it a lot more times to see what happens, I kinda want to see what happens if its ran for months
I see your virtual enviroment. however to build my own it does not want to build the wheels.
now teach it to do a randomizer nuzlocke.
Where can we watch the AI play Emerald?
I haven’t put anything up of it just playing, but maybe I will if enough people are interested in seeing it. I need to do some more work on it first though
Rempton Games YESSS I’m wondering how the AI picks Pokemon for its team
But how does the ai deals with Hms?
You watch RWBY? You should also watch Camp Camp
Well done coding this.... But my no means did you do any training. You made it discover (explore and remember) the map. Training would be to allow it to do hundreds of battles over and over until it learnt.
Last note, cool program to use memory addresses but humans never used memory addresses so computers shouldn't need it either. In old games like this everything is made of "tiles" which you could of employed a segment network to cache all tiles and meaning depending on Context
can i download this and run this myself?
I have a link to the GitHub repo in the description, and you’ll need a ROM and Open AI Gym Retro
@@RemptonGames I'm going to see if I can get it to work with pokemmo
So cool!
7:12 reminds me of cheat engine
it seems so next to imposssible to have a AI do 90% of the work rasing and hunting for the pokemon so then u can get rare shiny competive redy pokemon that of wich u can trade w/ to start a pokemon journy on ur own
Can't seem to download the OpenAI Integration UI :(
pythonrepo.com/repo/openai-retro-python-reinforcement-learning scroll down to the bottom and find the latest release. for me the program will run but i cant get any roms to run...
Was this AI able to beat the game and does it play gen 1 and 2?
Was there any logic by it choosing the female trainer?
How far can the AI play the game so far, did it beat Steven?
I wish I this clever
Soooo........ when does it actually play? You know, like, teach moves, cut down trees... and BATTLE POKEMON? Is it gonna catch one? You know you can't beat the game by just applying a pathfinding algorithm, right? There is nothing intelligent about this at all.
This code is borrowed, not impressed.