Can AI make another AI? Using ChatGPT to make an AI bot
HTML-код
- Опубликовано: 12 сен 2024
- We team up with ChatGPT to make an AI bot that can play the Flappy Bird game. Flappy Bird is a relatively simple game with few inputs and only one output. More sophisticated bots take in a larger number of inputs and can have many potential outputs.
Game developed in Unity
This was all done with ChatGPT-4
ChatGPT chose to use the Unity ML-Agents framework
We made Flappy Bird in a previous video using ChatGPT here: • Can AI code Flappy Bir...
I want to emphasize two questions from the Q&A at the end of the video:
Q: Is it safe to use AI to make more AI?
A: In the context of using AI to make bots for games, for sure - because the inputs and outputs are totally controlled. In the more general case - hard to say. These are powerful tools we can use to make more tools, but we should be careful with what inputs and output we provide them.
Q: You’re a game developer - are you condoning the use of bots?
A: Bots are a tool and can be used for a lot of things. If players are using bots to exploit games, gain an unfair advantage, or ruin somebody else’s experience, that’s not good. But bots can also serve positive uses such as being your targets in a PvE game, fun to practice against for a PvP game, provide a friendlier tutorial experience, or fill in for a teammate when they disconnect
-----
Discuss this video and chat about game development on my discord server / discord
I stream gam jams on twitch / candlesan
Twitter: / candlesan
This is Wyatt Cheng’s personal channel. In my day job I serve as Game Director at Blizzard Entertainment. This channel is an independent endeavor and not related to my employer in any way. The opinions expressed are my own and do not necessarily reflect those of my employer.
this guys gotta be a teacher the way he explains and details information is on another level
Yeah, he is just so thorough with explaining things. He splits up more complicated things into smaller easily digestible things. And he's really good at that too
Thank you! If there are any specific topics on game design or game development you'd be interested in learning more about please let me know.
@candlesan Hey! I have one! We all know a game feels good to play if it's 1. Responsive. 2. Fluid. 3. Impactful. How to, and what makes combat all these things? In theory mostly, as I don't think you'd have many examples to show. There are certainly animation tricks, sound tricks, even code tricks (for example action queues to make sure input is registered) camera and framing techniques and I'd imagine many more. I'm not sure anyone with similar experiences to yours have talked about this. Probably not even close! There are some videos on what makes a game feel good, but most of them don't touch on technicalities or components of these at all.
@@candlesan Would be cool to get some insights into blizzard workflows! :P
@@candlesan How did you make the bot see... i know its against ToS but I wanted to make a bot playing Diablo (not to exploit anything, but just to see if I could do it) but didnt have an idea on how to make the bot "see" the environment/the map - information of the game while playing is somewhere in the RAM memory where I wouldnt want to access it... since i did not have an idea i was also somewhat unable to make a proper prompt to chat gpt...
I'm blown away by how much information you're able to pack into these short videos. It has the welcome side effect of making them very enjoyable.
Thanks Archon!
People like you are very few in this world. Thanks for doing what you've been doing.
absolutely
facts
The way it rationalized "can't hit pipe if pipe not there" is the funniest thing in the world to me and a whole mood.
Ceci n'est pas une pipe
Most reinforcement learning algorithms are actually quite likely to come up with a lot of glitches for any given game :) This is due to them spending the first few thousand iterations basically trying every possible action for every state it finds itself in, as it's still not trained enough to recognize any action as likely being better than any other. So training an RL agent on a game could be a good way to discover new speedrun techniques 😅
As someone who's trying to find their footing in the vast world of game development, I have REALLY been appreciating your videos. Super well structured and insightful. It's also been really interesting to see these last couple of videos where you've utilized ChatGPT to work as an assistant in your programming. A lot of people are scared of how capable AI has become in the last few years but I feel that there's a lot of good that has come out of it as well.
Thank you for your work and I look forward to the next video!
There’s something beautiful about the way that the AI-written bot beat the game with an exploit in less than a second… Might not bode well for the future lol.
I found it super funny and a whole mood. And also I think this is good because it means you can use bots as players to test for exploitation in your games. if they are able to get somewhere they shouldn't, you need to correct that so they can't do it anymore. Pretty cool!
I came about your video by shere luck, and thank the algorithm for that! Your videos are high quality and interesting. Also your voice is very pleasant to listen to and you seem like a very intelligent and nice guy. This is great! Thanks for doing this!
Wow your video is so high quality man keep up the good work, it’s all so well structured, dynamically edited and well explained, you’re gonna go far
I like how you explain things, i know alot of the concepts that you explained but your explanation didn't make me get bored and made me continue through the video
It actually amazes me how much in common AI has with humans. I did the exact same thing on the original flappy bird back in the day. As soon as I started the game I tried going straight up to see if the dev messed that up lmao.
I think there should be a neural network you can train to play for you in some games, that way if you stop playing or become unable to play, your friends can still enjoy the experience of playing with you.
As an example Steep has "ghosts", aka a recorded session of your session in a challenge, and whenever I miss my best friend who is unfortunately no longer with us, I can boot it up and play with him again. It would be a bit more exciting if there was a neural network that imitated his playstyle however for some variation. :)
It'd be great if, in the future, if someone disconnected from an online game, we'd get an AI controlled bot that has been trained on that individual's games, and plays pretty much like they would have.
Excellent video. I need to get into machine learning it seems so fun. Especially within Unity.
I swear, every single ChatGPT video should have a ChatGPT counter to know who said it the most.
Insanely high quality content I wonder if he produces everything himself. You rock candlesan!
It's potentially confusing that you first say the agent will be trained using RL, but then describe what basically sounds kinda like genetic algorithms :) I understand that trying to explain gradients and fitting to predict actions for value would be way, way too technical for these types of videos, but I'm not sure that describing an entirely different type of algorithm instead is the best way to do it :)
That said, I do like both this and the previous video a lot! They're very entertaining :)
This is a great point! Thank you for bringing it up. I was trying to think of good ways to teach the concept in ways anybody could understand without getting into neural network diagrams or showing and math. I don't want to spread misinformation so I have made some cuts to the video to remove the parts that would be better thought of as GA rather than RL. Thank you for pointing this out.
For anybody visiting this comment later, the deleted section featured highly rewarded birds "mating" to produce offspring. In retrospect the Raynor example is likely sufficient and my "mating" illustrations risk leaving people with the wrong impression on an already complex subject.
Excellent tutorial. Would appreciate if you compiled all the prompts and all the replies by ChatGPT into a github or zip archive somewhere we could access. You’re really good at teaching concepts! One thing I wished we saw was how did you do the 50k, 150k, 300k, etc.. training sessions. I was a bit confused there
youtube lacks this type of educational content really thank you for your videos
One benefit of bots in gaming you didn't mention is one that you demonstrated - they can find exploits! Sure, the exploit it found at the beginning of the video might have been easily found with human bug crawling, but in the future, who knows how much more powerful this tool could be
that's amazing that you could create a game, and you still stick around with flappy bird, keep your track, thanks!
Idk why you don’t even have 250k?!?! 😅😂 you are a VERY good youtuber. Love to you man ❤
Careful about the roll-over command with dogs, especially dogs with deep chests, as it can lead to gastric dilatation volvulus, which is very serious and very deadly if not recognized and operated fast.
Every minute counts, so if your dog starts dry heaving, panting and has a hardened stomach, go to the vet immediately. Even if you just suspect it, it's better to go twice for nothing than lose your dog.
😂😂😂😂 are you the ai from metal gear solid
Hey Candlesan, with the rapid evolution of AI, I'm seriously considering creating an app with Chatgpt-4 and other plugins. However, I'm an amateur when it comes to coding. It would be really cool if you could provide a video or an answer explaining what level of knowledge is required to code an app with Chatgpt-4 on your own, if possible. In my case, i only want to design the app and give options and informations professionally
Amazing teacher and tutorial, your explanations are so clear! Subscribed!!!
Man this video is great. Love the way you produce vids and explain things ❤
The ai has to play the game only with the input state of moving up and forward with its wings. The location of the pipe's empty space needs to be recognized by receiving an image, but I don't know if it's possible.
The bot isn't looking at the screen, it's look at the game's internal simulation. As players we see pixels on a screen, but to a bot the world is represented by objects with co-ordinates in space.
Hey Wyatt, awesome video as usual. As someone who is quite new to games development and super eager and motivated, I really appreciate your insight & experience into issues like AI in games development etc... Since I am not really great at programming, I will most likely have to rely on the help of AI to create all the games that I have been envisioning all over the years.
I think you should keep making these AI game dev videos they're really good
Thanks for sharing this! Aside from this, we've also seen the autonomous AI agents from another video which you can use on another game. I've seen also that AI can be used on Unity and you can choose the different sources like images from Bluewillow AI for example.
TFW you realize Raynor was named after Jimmy 😭
Simply wow! Everytime I am just amazed with what you do with chatgpt. Creative and brilliant.
Please make 10,000 more of these. Subbed up, 👍
Very well produced video. I am impressed. 🎉
my dad gotta be proud after he knows i actually learn something from being on the computer all day
Youre a really underrated youtuber, Nice video!
these videos are super fun. it would be great if you showed the entire coding process, i bet there is lot to learn from it
These videos are super engaging, keep em coming!
Loved the story with the dog training, it is similar, and not.
I loved that the AI 'immeadiately' cheesed the game.
The other thing that I thought about the training models is not just generations of best performance, but also mutations to the bird-brains. Sometimes happy accidents can be helpful too. But that's a whole other topic, maybe by an AI expert.
It's the most natural way for the bot to cheat because it will likely spam the fly button when it is starting out since it has no concept of what to do other than keep flying.
I really enjoy your AI videos. It’s helping me learn code a lot! Thanks, candlesan.
Nice video! A simple way to make it take a whole lot less time to train is tweak the reward function to give a higher reward the closer it gets to the middle of the pipe gap. I think it would become super-human really quickly!
You may very well end up with a bird dive-bombing pipes in order to pass through the center 😂 Also, as you're not training to maximize the immediate value, but the total future value of any given action, you're better off not artificially restricting the state space. You could end up eliminating a possible future state that would've otherwise had a very high-value action.
@tobiaskarlsson7565 how did you get into ML I'd like to pick up some resources , I'm a dev
@@gabrielpauna62 I'm not entirely sure, to be honest 🤔 I would probably say I picked up a foundation from "Deep learning with Python" by F. Chollet, and then I started playing around with environments etc from Deepmind.
That original exploit was perfect. I was like "Yo did it literally find the true solution?"
Did you try walking backward from the starting point in the game? 😀
Awsome video. Now I want to start making things with chatGPT :) Keep up the good work 👍
I remember that in the early 2000s with games like Farcry and Crisis pushing the envelope there was a lot of press talk about the enemy AI and their reactions to the players performance.
How far has this advanced by now? Not just in terms of combat but also creating immersive RPG worlds? Or is it just too broad to create a cohesive experience. Lately RPGs leaned heavier into progression paths and reputation with NPCs etc but those mostly fall into scripted outcomes. The only genre where I at least saw discussions about the opponent AI topic lately were racing games. Might be personal bias or lack of a broader experience but: Where are we in terms of AI reacting to players actions as part of the gaming experience?
Edit: the Google AI once had showmatches against players in Starcraft 2 (and then there is also Chess and Go), but outside of these incidents I haven't noticed much talk about opponent AI development. WoW had the Island expedition and Warfront as well as PvP brawl AI features but those still feel like a locally obvious script compared to a globally scripted encounter.
AI is a fairly general term but I'll comment from two different angles in response to your question (but there are other meanings as well)
- AI has advanced an enormous amount for games since Farcry and Crysis but the important note here is that "super realistic behaviors" isn't what you're looking for in many games. The objective is usually an illusion of realism with meaningful and fun gameplay experiences for the player.
- There is extensive opponent AI development, it just doesn't make headline news, but there is definitely development of AI opponents for almost all games out there whether it be connect-4, poker, etc or computer games like FIFA or Fortnite
Amazing content about game development with ChatGPT ! thanks again for posting.
Cool video. Your voice sounds a bit robotic due to what I presume is some post-effects.
Your videos are great and more game devs should post on youtube about game development.
I guess what the question of fear is, can eventually all AI bots trained for various tasks connect their knowledge and breed? Or are they individuals like humans? But eventually workout how to share their knowledge?
your explanation is just epic :)
Excellent video and very interesting content. Cant begin to imagine how you wrapped your head around this stuff.
ChatGPT coded a way for people to find your channel.
i like how his voice audio doesn't change when his outside and inside home.
Candlesan has mastering AI chat bot that he soon will be the representative for the AI.
He killed me when he said bird brains
Great teaching, especially with the amazing visual examples.
Thanks 'Reynor' ❤️
at this point i dont want to call you candlesan.... you are CANDLE SENPAI :D teach us more pls its so interesting and you explaint everything very good
This man shows us the example of how Skynet developed
Finally an AI video that's actually interesting again :D
nice choice of games to train an AI on, haha, you just wanted to say 'bird brain' rofl, also thanks for sharing!
I have an idea for you to try to make! A pacman game where the monsters are so good that you can not possibly win. LOL!
Puppy got a PAWsitive reward.
Seems like AI bots will also be a great tool for playtesting / bug finding in the not so far future.
That text box design is gonna have Nintendo trying to sue you lmfao
You make it look easy that I want to learn AI 😅.
Is it possible to see/download the code for the bot?
If we want to get a bot to learn a simple game without the game source code, would it be possible?
This is an amazing channel. Thank you for sharing :)
this is a gem of a videa
Playing god, aren't we?
You could assign an AI agent/agent GPT to try and learn and create another AI. Basically, an AI learning and creating another AI. A lot of AIs could make use of it especially for the those that utilizes deep learning like singular task AIs like Bluewillow AI among others.
When the Bald One arrives, your channel will skyrocket.
Awesome really awesome content. Please complete this quality content!
this is amazing i really wanna play/watch it play for me
Waiting for more AI game videos. Love from Kashmir 🍁
You're a legend
Finally, AI makes itself obsolete, take that AI!
Would be sweet to make an AI bot to play the OG Battle Toads on NES
You are so wholesome!
Love it this is some out of the box thinking right here!
Id also love to see the troubleshooting done as well with those errors maybe in a side video?
Chino tenías que ser!
Que grande ❤
Awesome video ;)
This was a great video!
It would be nice to have a video on art generation for small prototype games
actually stellar content!
Very very interesting.
very engaging
Great video. Gorgeous dog too, what breed is he?
It's a mutt - I'll let my friends know though!
Well done wideo :)
Excellent!!!!!!!!!!!!!
Brother, do not open Pandora's box! There are 2 things in this life you cannot do - divide by 0 and ask an AI to create another AI.
As long as it can't make a more advanced AI than itself we are safe! (I'll keep telling myself that)
Now make a side-scroller like Mario Brothers. 😀
SO GLAD I HAD AI IN SCHOOL
I didn't know you had 2 twins 🤯
Can you add to your notes - how long did this one take you?
next video: can a ai make youtube videos
so cool !
Lovely video ❤ I have a problem sir, Unity isn't working on my PC 😭 I have asked many game developers in the comments but nothing works for me. And I can't afford a new one at this time. Please give me any suggestions. I really wanted to be a game developer for a long time.
Try doing a clean install with Unity Hub with sufficient hard drive space free. Good luck!
Thats sick
Just wow 😮😮
my favorite programmer
keep it up boss!
really clean prompts ngl
You are awesome :D
For the nerds... you should be trying to get chatgpt to be a GM in DnD.