OpenAI's AI Learned to Play Minecraft from YouTube Videos
HTML-код
- Опубликовано: 18 окт 2024
- ➡️ Visit brilliant.org/j... to get started learning STEM for free, and the first 200 people will get 20% off their annual premium subscription.
Watch this video ad-free on Nebula: nebula.tv/vide...
🐦 SOCIAL STUFF:
Instagram ➔ / jordanbharrod
Twitter ➔ / jordanbharrod
Tiktok ➔ / jordanbharrod
Vlog Channel ➔ / @checkedoutbyjordan
Weekly Newsletter ➔ www.jordanharr...
AI Reading List ➔ bookshop.org/l...
Anywhere Else You Might Find Me ➔ linktr.ee/jord...
For business inquiries, contact me at jordanharrod@standard.tv
Thumbnail Created using OpenAI DALL-E 2
Sources:
OpenAI Blog: openai.com/blo...
Pre-Print: arxiv.org/pdf/...
minecraft openai dall-e openai dalle openai gpt 3 openai gpt-3
What the researchers didn't expect is that the AI also became extremely proficient at making 30 second loud 3d-name-flashing-over-electronic-background youtube intros.
I'M CRYING THAT'S GREAT
I'd love to see an AI playing Among Us
it would require using a very powerful NLP model like GPT-3, and I'm curious to see it deceiving players
It could have some advantages over regular players if you let it. Not from an AI perspective, but if I was guessing how you would program a robot to beat the game in a non-intelligent way, I'd have it record all the times to different parts of the map. By knowing all the routes and how long they take, combining that with whenever it spots different players, when players die, it could sort of attack it like a game of 20 questions. If it knows how many imposters there are and the rough location of certain players at different times it could assign probability points to different players.
Short of having a system that could understand other players speech you could have a sort of menu where players could vouch for other players in the emergency meetings. Player A says they were with Player B sort of stuff, so it could at least participate in the sharing of knowledge.
The fun part would be programming it to kill. I suspect with all the timing stuff it could figure out, I think it might be pretty good at that.
"This AI researcher learned to play minecraft from hours of youtube comments"
😂
Would you play minecraft if I told you you can build logic gates in it?
Actually, it could be fascinating to see AI tackle redstone (the basic 'wiring' system in minecraft). I'm not sure how you would define goals for it though, since people do everything from building giant mining machines to breaking unbreakable blocks using timing glitches. A lot of the most interesting stuff comes from unintentional behavior from the game. For instance, the game uses loaded chunks (the ones closest to the player), and unloaded chunks (where no players are) but there are 'lazy' chunks- spaces where mobs can exist but don't move. I've seen someone rig a trap to explode using a chicken buried in a hole deep underground, at a precise depth so that a player walking on the ground above it moves just close enough to activate the area where the chicken is, so the chicken 'unfreezes' and triggers a pressure plate. The deep understanding of all the different quirky rules, intentional and unintentional, and the clever ways people use them to create devices is amazing. (I get a little too ADHD when I'm playing to stay focused on big projects).
I'd be interested I somebody training a simple neural net within Minecraft. You'd probably need to tick warp for it
I feel like, despite it's apparent simplicity, it'd be a real challenge to get an ai to play among us properly since it's a social deduction game with a lot of other features that make it more complicated, but they'd probably be able to do tasks really quickly.
From the video of the AI playing minecraft, it looks like it's imitating the kind of thing that the Lets Players do when talking by punching the ground to emphasise the words that they're speaking
Pretty fun :P
Teaching AI Among Us, aka lying, sounds like a recipe for disaster. Kinda sus
I can't get enough friends together to play Among Us, but I've watched it a lot. It would be interesting to see a dataset that analyzes players playing style. I always tried to play games like Clue by eliminating possibilities and less by trying to read other players. I wonder how much the bluffing part of Among Us really plays into winning, at least as long as you have someone who is reasonably competent at lying. If you say you were with Player 2 and you weren't, that sort of lie is going to possibly get you caught (throwing suspicion on you and player 2, at least), but I think you could sort most of the statements into just a few fairly simple types- lying about where you were, lying about who you were with as an alibi, lying about someone else to throw suspicion on you, lying that you were doing a specific task... the fact that you are randomly assigned to be the crew or the imposter means that pretty quickly everyone's assumptions about who is normally honest and who might be sus, pretty quickly turns everyone paranoid.
/I'm an admin on a FB group. We have security questions, including a basic "I am a human/I am a bot" question. I'm constantly amazed how many people answer that they are a bot. Or maybe they are 'people'?
For context, to create a crafting table requires just a few common materials that can almost always be found right near where the player starts the game. The diamond pickaxe requires the player to mine deep into the ground, confronting cave systems, environmental hazards, hostile creatures and etc... it implies that the AI can do many things, including dig, craft, fight, navigate long distances, and locate rare resources.
It requires:
Making a wooden pickaxe to mine stone
Making a stone pickaxe to mine iron
Finding iron
Making an iron pickaxe that can mine diamond
Making torches to delve deep into the ground
Finding the fairly rare diamonds, which only exist at specific depths
Making the diamond pickaxe
It's a lot of steps
This is super cool! Minecraft is one of the most technically complex games out there, so even if the AI can only perform basic tasks like mining, crafting, fighting, etc. it's still really impressive!
Edit: JORDAN YES I NEED THAT AMONGUS VIDEO NOW
”Siri is trying to teach me to play minecraft” 😂😂 made me laugh. But super interesting video, and a interesting study indeed
Minecraft is not an arbitrary game, it's extremely open ended, and it's unclear how to build things out of other things, which constitutes a lot of what is done in minecraft -- you mine, stay alive, and turn objects into other objects through machines which you build out of objects. It's unclear how you make any of these objects. Among us is simpler in that it has a limited scope and goal, even though it is still quite open ended.
It looks like they simplified Minecraft. They turned off monsters. That makes the game far less chaotic. It's an interesting way of programming an AI do tasks in an open-ended environment.
I wonder what the minimum number of videos needed.
Discovered you and this episode in particular through Nebula!
something i feel like could be interesting is what happens if AI is fed data from top players or speedrunners, for example, and how it would recreate this.
for example, let's take not minecraft, but celeste (if you don't know, it's a good platforming game famous for speedrunning and modding potential). if you fed to it basic information about basic controls and ways to execute the complex techniques like ultra- and demodashing, then feed it the data of top runners chaining these together in a speedrun, then it'll learn these techniques and incorporate them when it plays (and then it playing the main game would always be those inputs over and over, just like a speedrunner would play). now when you give it a new modded map (and ensure that the ai already knows what the new modded stuff does), you could run it and theoretically have it speedrun through it while it's their first time seeing the map.
If it takes that amount of effort to get through the first ten minutes of minecraft, are those models gonna scale? Or, more specifically, HOW are these morels gonna scale with many more open-ended tasks?
Minecraft actually has been having an ai boom
Happy Birthday, Jordan. Signed RF Technician that blew a Gasket pursuing a Mathematics degree while working Full Time 🤣🤣🤣
Imagine an AI doing advanced redstone builds 😱
We're very close to actually having good CPU opponents in fighting games.
On further thought, if you think you could make a fighting game AI, you could probably license it as middleware. No joke, the genre really badly needs computers that are 'human-like'. It would be a quantum leap for training people to be competitive.
I'd love to see an AI taking a shot at Among Us!
An AI that plays Among Us is a whole nother level of sus.
Oh great! AI can play Minecraft now (and it's probably better than me).
Among Us is a Unity game so you can make API on your own with dependency loader. It's not that hard.
Isn’t this Inverse-Reinforcement Learning? I thought this was an established field of RL.
100% that among us video is something I need
That would be a cool video!!
Intresting
Amoung us would be very cool
Yes, please, Among US! Just... maybe... don't have the ML watch Chilled Chaos' videos, as he's adorably ridiculous and nonsensical while playing (even though he does win a lot).