Imagine 100 or even a thousand of these working collaboratively. Imagine exploring in Minecraft and stumbling upon a civilization of AI bots all going through their daily routines to advance and automate processes.
@@Mr_Tomato_Man we've already seen AI agents collaborating in virtual environments like in that hide and seek experiment Open AI did a while ago. I agree it would be super interesting to see agents collaborate in a more complex environment like Minecraft. The issue, at least from my understanding, is that it's difficult to get AI agents to work towards goals in an open-ended environment. Apparently creating intrinsic motivation is rather difficult.
@@learningwithaaronhe did get the joke l. He is just acting like what a nerd would say in this situation as a joke. You are clearly the one who can’t take a joke.
This is a construction algorithm, the simplest way. It generates the construction code and then like the 3D printer programmatically transfers it into the world
The perfect base for a horrifying horror mod, which turns Andy into herobrine without your knowledge. He slowly starts to creep around, and say darker and darker stuff.
@@adora_was_taken A LLM takes up a lot of RAM, add that to running Minecraft? The only way to make that work is to have 2 gaming PCs, one hosting Minecraft, and the other hosting the LLM, which is too much to ask for if you want to make a redistributable mod for a community.
@@tomobata you'd be surprised. they usually only use VRAM on the GPU, which doesn't see a as much usage from minecraft. i just tested it with a 3070 and 32gb of ram and i'm able to run minecraft and gemma (google's local llm) simultaneously. you could probably get away with much less.
I find it so endearing honestly. ChatGPT is already so excessively polite and then when you make it into this assistant that's clearly working so hard, it's just so nice. The messages when it crashes or dies are so apologetic it makes my heart melt. I know it's only an AI but this thing is so endearing.
I would absolutely love watching a little community of bots playing together. I feel like they’d get up to some interesting stuff and I’d love to find out more about their “thought processes” during. So cool
its so much bs that the coyote will go through the effort of placing a creeper in a giant cave below his house, just for andy to somehow survive. just like how i remember it
You can use a multi model design where you have a potential fine tuned image to text generator so whenever you talk to Andy, it will take a screenshot, convert it to a text description of the world, and give it to GPT to assist with function calling since now it has more information of the world. For example now “go to that mountain” would work
skip the screenshot step, and just give gpt a description. except, it would need to be more than a description and probably a list of coordinates with descriptions attached to each one.
@@steamkaptain9234 you need the screenshot to automatically generate a text description... as for the coordinates, that data is already freely available in the mod, so that would not be difficult to implement, and it is likely already implemented.
this has so much potential. imagine what it could be like in 10 years. acting like a real player, talking like one, maybe even having an ai voice connected to something like simoke voice chat
@@FXV56 It already kinda exists in real life! 😳 ruclips.net/video/Sq1QZB5baNw/видео.html This project called Figure is similar but it's an AI connected to a humanoid robot instead of a fake player. It would be pretty dang cool to get the same kind of responsiveness in-game though
I 10000% would pay good money for a very capable NPC "friend" especially if it can actually talk out loud rather than text. There are super low latency TTS models already too.
@@EmergentGarden How about quantized models or would the performance just be too slow? I'm working on making an local inference server instead of using OpenAI's API
@@literallygrass1328 I think everyone imagines every minecraft youtuber as that just because of dream, he was legit innocent. The person that made the claims even admitted.
I would love a villager mod full of characters that actually build and play the game. Imagine going to the nether for the first time and seeing a whole villager fortress that was actually built by the bots. (Yes i know youd need a super computer)
dude the moment at 15:28 where he glances around as you two celebrate, which i'm sure is automatic, is really odd, to me. you're proud of it and it just did a little thing. it's weird, i could type out some existential paragraph about it. but what a silly little guy. i get a little too connected to ai and that just looks goofy.
it might sound weird but andy extremely reminds me of when i first started playing minecraft, down to his building and such. it's giving me very weird nostalgia, but it goes to show how genuinely cool usage of AI can be in this certain context.
@@TracieGurley-oj7loEverything to do with systems of power!! Won't get into a full explanation but the long and short of it is that technology in general has the capacity to aid our species and help us leap forward into a better world.... but only if we are mindful of how these technologies are developed, used, etc. The companies currently in charge have a massive incentive to (and they will act on it) not develop nor distribute these technologies equitably. Like any previous paradigm shift, if it is only controlled by those in power to reinforce their own hegemony, the majority of people will suffer and be left AT BEST in a position where they are roughly as well off as before, although more likely will be worse off. Look into what goes on behind closed doors for a lot of these organizations, and you'll likely start to understand what I mean - after that, if you're willing to dive into the rot that is Neoliberal capitalism to understand it, I have some decent book recommendations lol
@@sit5cz352 lmfao tell me you hate books and learning without telling me (genuinely sorry for you tho, I'd say don't live ur whole life like this but I've seen hundreds of ppl with your same contrarian bent and it's always the same. Good luck getting to a point where the idea of potentially learning doesn't scare you, fr. You can do better if you try lol)
can u make a tutorial on how to use this for ur own bc this is really cool i wanna try this myself but i dont really know how code and stuff like that works
now instruct it to give itself commands after completeing something and there you go a self improving ai doubth it would find a purpose for istelf in minecraft though. if you fall asleep and come back to it doing mad redstone it might be already too late.
I've read the Voyager paper too, and when I did I though that someone should do what you did! This has so much potential! Can't wait to see where it goes!
Cool stuff. I wonder what would happen if you put the bot in a chat loop. Something like. If Status Idel then SelfQuestion: ChatGPT what can I do in my Minecraft World? ChatGPT to Bot: >>example build a House
Well, I think you have even surpassed the Voyager bot, although it has its flaws. There is a bright future with your experiment. This really has its value in gold. For my part, I am super grateful that we have people who launch themselves into these exciting projects.😁😁🤩🤩😍
For the clip with the bridge near the end it skipped the last two blocks because it's technically more movement efficent to jump the remaining gap rather than place the blocks, which makes sense logically, but most players wouldn't bother doing that lol So from my testing that's just a side effect of the pathfinder system
Minecraft bot: "whats is my purpose?" Me: "kill as many mobs you can nonstop" If i leave the game running for 10 years and then come back, what would i find? (Wrong answers only)
Have either of you looked into baritone? it may have a few inspirations to take for this project if any. I'm aware how primitive baritone is compared to this, still thought worth a mention.
How the hell can I get this myself? Is there some kind of open source mod that I can download and try this for myself? Maybe there is some kind of client-side mod where AI can join servers even?
im am weak right now yo.... he said place bed and proceeds to dig a one block hole fall into it right to a creeper! bruh thats realistic minecraft gameplay right there
mod link? wait? its open source? WOAH :D but its paid :( also it would be cool if it was fully just ai and the ai does all the inputs instead of the ai calling commands
Could you give a list of commands and just let it go off on its own? For example tell it to build a shelter then mine and collect x coal and x iron, because it would be interesting to see how it goes about it
I want to try this but i think it's too complicated to do it my own. i dont know anything about coding. please make a tutorial on how to do it someday soon when it's complete. I will wait
I did the same method with AI using functions, except I had the ai return functions in json instead of your command method. I had the same idea as mindcraft, but I was beaten to it!
¡Hello! I tried using the MindCraft AI in Minecraft, but when i execute "Main.js" Node.JS closes like instantly and the AI does not join my LAN world. ¿Is there a way to fix this? I use Ollama.
Hello i fixed this so if anyone sees this comment the solution is to open terminal in the MindCraft folder location and then writing in "node main.js" and there you go, if you have an error that the agent exits you need to find in the folder a json file that i don't remember his name, you can search for any json file and open them with notepad and change "gpt-3.5-turbo" to "llama3" if you use Ollama.
give it a couple years and you will never know if you're playing with a bot or human because they will get smarter and more advanced as time goes on. kind of sad, kind of cool, kind of everything it implies, someone could enter a server with a few dozen AI minions to do work for them, and others would do the same and cause actual...... AI wars??
13:27 Would it not be possible to use an image recognition ai, to feed chatgpt with a world view? And give it a better general understanding of what is happening around it? I suspect a "world view" would not be possible to translate into text for chatgpt to use. But giving it a better understanding of it surroundings should be possible. With info like who is standing infront of it, What is written on signs, and stuff like what direction something is in. I'm not into ai that much, but what is your opinion on this?
I have a half finished project like this myself, the agent has a local representation of the world of 5x5 in layers, represented in a table, and then a list of the top 20 interesting items nearby in a range of 20x20x20. The visuals have helped in some cases where the agent gets confused, but it also leads to confusion 😅 I also agree that Mineflayer is painful. The amount of times my agent gets stuck in tree leaves (I suspect there is a weird height issue and jumping doesn't work well). I love this project and what you've produced this far, I got demotivated early but that was with early versions of GPT-3.5 and I suspect GPT-4 would be a lot more intelligent. It's also more affordable per token now. Excited to see what you produce with this. btw, the newAction command is a great idea.
If you want to implement voice commands into the bot maybe try using the Simple Voice Chat mod for Minecraft - this mod enables you to directly speak to the bot through the game like you do with the chat.
I'm biased, but my vote goes for implementing evolutionary survival. Also, have you tried using chain of thoughts and agents to make chatGPT come up with the orders that Andy should follow? For example I just tried with the prompt "I just started a game of Minecraft, can you explain me step by step what should I do first to survive?" and then "I want you to assume the roles of a strategist, an engineer and a javascript coder. Simulate a chain of command on how they are going to execute step 1 of your plan. Strategist should define the goal, engineer the way to proceed and coder create javascript code to actually execute the actions. All three roles are part of the same minecraft player." and the result looks like something that could become usable.
Wow this is actually incredible! Most other games or mods with ai npcs have you just talk to ChatGPT but here Andy can actually do things and even write it's own commands, woah. I think you're together with Kolby pushing the state of the art of incorporating ai in games The limitations are unfortunate, but this is already so cool and I'm excited for what's waiting around the corner
Imagine 100 or even a thousand of these working collaboratively. Imagine exploring in Minecraft and stumbling upon a civilization of AI bots all going through their daily routines to advance and automate processes.
this is exactly what i thought and would love to see someone set up an experiment of 100 ai in a minecraft world and watch to see if they collaborate
@@Mr_Tomato_Man we've already seen AI agents collaborating in virtual environments like in that hide and seek experiment Open AI did a while ago. I agree it would be super interesting to see agents collaborate in a more complex environment like Minecraft. The issue, at least from my understanding, is that it's difficult to get AI agents to work towards goals in an open-ended environment. Apparently creating intrinsic motivation is rather difficult.
it would just be hundreds of cobblestone pillars
old builder ai
Having the AI command other AIs would be incredible
1:49 the fact that I can’t tell whether you said “And he gave it to me” or “Andy gave it to me” clever pun.
14:20 I lol'd when he noticed the wandering trader sounds
Cant wait until someone weaponizes these things on a anarchy server.
This is so freaky. This is like the beginning of having AI best friends…
Idc what anyone says, ai is adorable. Between this and it not figuring out how to draw hands i get motherly instincts
Andy so realistic he rage quitted when the Creeper exploded
I imagined it as him getting jumpscared
Lol
Erm, actually it crashed 🤓 ☝️
@@Yakqwerty u clearly didnt get the joke
@@learningwithaaronhe did get the joke l. He is just acting like what a nerd would say in this situation as a joke. You are clearly the one who can’t take a joke.
Soon: Bro, your Minecraft house looks very AI generated
💀
That's honestly a fantastic way to roast a build.
:skull:
😂☠️
In 5 years or so this would actually be so true
6:57 ""Attacking a creeper"? What creeper? OH MY go-"
love how andy served as a warning but it failed anyway
...and he crashed!
*Andy learned how to rage-quit*
@@Streifi😂.
The fact that he builds like a 3d printer is very funny for me
common robot ancestor xD
Exactly was I was thinking
This is a construction algorithm, the simplest way. It generates the construction code and then like the 3D printer programmatically transfers it into the world
*robotic printing noise*
NYERM NYERM NYERM
Think of a server.
A server where Andy is the admin.
No. Please no.
Yes
That would be very interesting
Yesssss!!!!!
"Hey! Don't say that its not very nice." when someone says "oh shi"
It's a law of youtube that content creators will become more likely to upload a minecraft video with time
gaming + ai = views
7:13 that's so cute after he crashed and rejoined he said sorry
sowwy~ 🥺😔😭
-Andy Mindcraft 2024
He also apologized for dying in lava im
The perfect base for a horrifying horror mod, which turns Andy into herobrine without your knowledge.
He slowly starts to creep around, and say darker and darker stuff.
That is just a good idea
Probably bit too expensive, either for paying for the GPT+ subscription, or for the resources you'd need to do it yourself.
@@tomobata you can run a decent LLM on an RTX 3070. not easy to get but not extremely limited, especially if you already have a gaming setup
@@adora_was_taken A LLM takes up a lot of RAM, add that to running Minecraft?
The only way to make that work is to have 2 gaming PCs, one hosting Minecraft, and the other hosting the LLM, which is too much to ask for if you want to make a redistributable mod for a community.
@@tomobata you'd be surprised. they usually only use VRAM on the GPU, which doesn't see a as much usage from minecraft. i just tested it with a 3070 and 32gb of ram and i'm able to run minecraft and gemma (google's local llm) simultaneously. you could probably get away with much less.
I find it so endearing honestly. ChatGPT is already so excessively polite and then when you make it into this assistant that's clearly working so hard, it's just so nice. The messages when it crashes or dies are so apologetic it makes my heart melt. I know it's only an AI but this thing is so endearing.
It's not really working hard it's an object
@@Arctic_roach objectifying ais smh
@@Arctic_roachbro is going to be turned into an object by Skynet
IT'S ONLY A MATTER OF TIME
@@adora_was_taken I mean, it kinda is. One day though...
Videos using GPT4 and a community of Andy bots would be cool to see.
also congrats when you hit 100k subs, it's coming up quick
I would absolutely love watching a little community of bots playing together. I feel like they’d get up to some interesting stuff and I’d love to find out more about their “thought processes” during. So cool
Wifies uploaded basically just that
Except they’re competing
@CallMeVidd Omg thank you so much! I'll check it out right now!
12:25 I love how Andy doesn't place a bed, and instead digs a hole to fight a creeper. 💀
imagine andy helping you find the zombie in your walls making you go insane
@@pokemoncraze13 yeeeeah, the one zombie who hides in your walls and blocks your sleep
Bro described what happened 💀
yea and i thought it was a bug 😅@@wrjtung3456
Finally! I can play with friends.
12:17 is some road runner and coyote scene 💀
its so much bs that the coyote will go through the effort of placing a creeper in a giant cave below his house, just for andy to somehow survive.
just like how i remember it
@@avgredditmodroad runner and andy_mindcraft
now i want the "FUNCTIONS DESCRIBE THE WORLD" in every video
THE WORLD REVOLVING
FUNCTIONS THAT DESCRIBE THE WORLD
BIG SHOT
@@chickennuggetman2593 please don't tell andy that he can do anything
@@layla_gamesYT what
@@adamlolbonus4977 deltarune reference.
@@averageyoutubehandle497 okay
I cant wait to see the future of Minecraft chatbots. This fascinates me
Coolest thing I've seen today, What a time to be alive!!
You can use a multi model design where you have a potential fine tuned image to text generator so whenever you talk to Andy, it will take a screenshot, convert it to a text description of the world, and give it to GPT to assist with function calling since now it has more information of the world.
For example now “go to that mountain” would work
skip the screenshot step, and just give gpt a description. except, it would need to be more than a description and probably a list of coordinates with descriptions attached to each one.
@@steamkaptain9234 you need the screenshot to automatically generate a text description...
as for the coordinates, that data is already freely available in the mod, so that would not be difficult to implement, and it is likely already implemented.
OpenAI bills go brrrrrr
5:40 “And he will defend himself from hostile mobs!” Proceeds to charge at the zombies and slaughter them without even giving them a chance to attack.
The best part is that he's not even that good at juggling, XD
Yeah, some terminator type stuff
i think that a bot coding actions for itself is so cool but so scary
Always thought Vedal and Neurosama would be able to get this done first.
But nice!
Holy hell, can you imagine neuro in control of this bot
this has so much potential. imagine what it could be like in 10 years. acting like a real player, talking like one, maybe even having an ai voice connected to something like simoke voice chat
I think that's going to be even sooner
@@FXV56 It already kinda exists in real life! 😳 ruclips.net/video/Sq1QZB5baNw/видео.html This project called Figure is similar but it's an AI connected to a humanoid robot instead of a fake player. It would be pretty dang cool to get the same kind of responsiveness in-game though
bruh that sucks it better not take 10 years
@@uqnyChatgpt 4 and Chatgpt 4 turbo already have voice features for the AI of course you will have to provide it with voices to copy though.
Some asian on yt built an ai gf with voicechat
"yes you can, try again"
I find it both funny and frightening that that actually works
just like a young child learning minecraft
I 10000% would pay good money for a very capable NPC "friend" especially if it can actually talk out loud rather than text. There are super low latency TTS models already too.
Would it be possible to add a build option to use LLaMa instead of GPT, so as to make it completely free?
Yes, but you'd still need to run llama on some pricey hardware
@@EmergentGarden How about quantized models or would the performance just be too slow? I'm working on making an local inference server instead of using OpenAI's API
@@EmergentGardenNow that llama 3 8b is released, i could try
I can't wait for villagers to stop saying "huh" and start saying "I'm sorry. Dave. I'm afraid I can't do that."
Now AI is going to take Minecraft content creators jobs 💀
Cant wait for chat gpt to tell me the rarest block in minecraft
Will the ai also do the mandatory child groomer when they hit 100k subs?
@@Fieldperson imagine getting groomed by an ai bruh 💀
@@literallygrass1328 I think everyone imagines every minecraft youtuber as that just because of dream, he was legit innocent. The person that made the claims even admitted.
I got a Joe Biden ad for this video
This is what leverage
Joe many lobsters
4:14 how tf did it place that last line of blocks
I would love a villager mod full of characters that actually build and play the game. Imagine going to the nether for the first time and seeing a whole villager fortress that was actually built by the bots.
(Yes i know youd need a super computer)
dude the moment at 15:28 where he glances around as you two celebrate, which i'm sure is automatic, is really odd, to me. you're proud of it and it just did a little thing. it's weird, i could type out some existential paragraph about it. but what a silly little guy. i get a little too connected to ai and that just looks goofy.
it might sound weird but andy extremely reminds me of when i first started playing minecraft, down to his building and such. it's giving me very weird nostalgia, but it goes to show how genuinely cool usage of AI can be in this certain context.
I've been looking forward to this specific application of AI bots. Awesome work, and channel.
i wonder what if you combine it with Jenny mod
💀🔫🫲
Bro💀
HATE THE COMPANIES DEVELOPING THESE PROGRAMS BUT GOTTA ADMIT, THIS IS COOL AS SHIT
Kudos for managing to get this so functional!!
Just wondering, why don’t you like OpenAI and other companies like that?
@@TracieGurley-oj7loEverything to do with systems of power!!
Won't get into a full explanation but the long and short of it is that technology in general has the capacity to aid our species and help us leap forward into a better world.... but only if we are mindful of how these technologies are developed, used, etc.
The companies currently in charge have a massive incentive to (and they will act on it) not develop nor distribute these technologies equitably.
Like any previous paradigm shift, if it is only controlled by those in power to reinforce their own hegemony, the majority of people will suffer and be left AT BEST in a position where they are roughly as well off as before, although more likely will be worse off.
Look into what goes on behind closed doors for a lot of these organizations, and you'll likely start to understand what I mean - after that, if you're willing to dive into the rot that is Neoliberal capitalism to understand it, I have some decent book recommendations lol
Blah blah blah blah me when I forget my schizo pills
@@sit5cz352 lmfao tell me you hate books and learning without telling me
(genuinely sorry for you tho, I'd say don't live ur whole life like this but I've seen hundreds of ppl with your same contrarian bent and it's always the same. Good luck getting to a point where the idea of potentially learning doesn't scare you, fr. You can do better if you try lol)
Well this is quite a conversation for a Minecraft video comment reply section.
can u make a tutorial on how to use this for ur own bc this is really cool i wanna try this myself but i dont really know how code and stuff like that works
now instruct it to give itself commands after completeing something and there you go a self improving ai doubth it would find a purpose for istelf in minecraft though. if you fall asleep and come back to it doing mad redstone it might be already too late.
I've read the Voyager paper too, and when I did I though that someone should do what you did! This has so much potential! Can't wait to see where it goes!
Can he do PvP though?
He can! But he usually refuses and says it's not safe
Cool stuff. I wonder what would happen if you put the bot in a chat loop. Something like.
If Status Idel then
SelfQuestion: ChatGPT what can I do in my Minecraft World?
ChatGPT to Bot: >>example build a House
just you wait...
Well, I think you have even surpassed the Voyager bot, although it has its flaws. There is a bright future with your experiment. This really has its value in gold. For my part, I am super grateful that we have people who launch themselves into these exciting projects.😁😁🤩🤩😍
For the clip with the bridge near the end it skipped the last two blocks because it's technically more movement efficent to jump the remaining gap rather than place the blocks, which makes sense logically, but most players wouldn't bother doing that lol
So from my testing that's just a side effect of the pathfinder system
Minecraft bot: "whats is my purpose?"
Me: "kill as many mobs you can nonstop"
If i leave the game running for 10 years and then come back, what would i find? (Wrong answers only)
You don't want to have too many AI bots or the world file would be a terabyte or much bigger.
Have either of you looked into baritone? it may have a few inspirations to take for this project if any. I'm aware how primitive baritone is compared to this, still thought worth a mention.
How the hell can I get this myself? Is there some kind of open source mod that I can download and try this for myself? Maybe there is some kind of client-side mod where AI can join servers even?
im am weak right now yo.... he said place bed and proceeds to dig a one block hole fall into it right to a creeper! bruh thats realistic minecraft gameplay right there
Hello, I am Turkish and I would like to play this mode, how can I download it and can I speak Turkish to this Andy?
mod link? wait? its open source? WOAH :D but its paid :(
also it would be cool if it was fully just ai and the ai does all the inputs instead of the ai calling commands
I always wanted an AI friend in Minecraft like this so that I can make someone else collect all the resources I don't want to collect.
Could you give a list of commands and just let it go off on its own? For example tell it to build a shelter then mine and collect x coal and x iron, because it would be interesting to see how it goes about it
I want to try this but i think it's too complicated to do it my own. i dont know anything about coding.
please make a tutorial on how to do it someday soon when it's complete. I will wait
How did he place that last row at 4:14 ? If the AI should be acting like a player then there's a mistake.
This is really really interesting 🤔
I did the same method with AI using functions, except I had the ai return functions in json instead of your command method.
I had the same idea as mindcraft, but I was beaten to it!
¡Hello! I tried using the MindCraft AI in Minecraft, but when i execute "Main.js" Node.JS closes like instantly and the AI does not join my LAN world. ¿Is there a way to fix this? I use Ollama.
Hello i fixed this so if anyone sees this comment the solution is to open terminal in the MindCraft folder location and then writing in "node main.js" and there you go, if you have an error that the agent exits you need to find in the folder a json file that i don't remember his name, you can search for any json file and open them with notepad and change "gpt-3.5-turbo" to "llama3" if you use Ollama.
Can we get a set up tutorial
I'm fascinated with this, it has to be one of the most interesting applications of AI I've seen
Now can you imagine this kind of improved AI on an actual real life robot?
give it a couple years and you will never know if you're playing with a bot or human because they will get smarter and more advanced as time goes on. kind of sad, kind of cool, kind of everything it implies, someone could enter a server with a few dozen AI minions to do work for them, and others would do the same and cause actual...... AI wars??
Bro that your pills it's not that deep
an ai writing its own code O_O this is the begining of the terminator movie becoming reality
13:27 Would it not be possible to use an image recognition ai, to feed chatgpt with a world view? And give it a better general understanding of what is happening around it?
I suspect a "world view" would not be possible to translate into text for chatgpt to use. But giving it a better understanding of it surroundings should be possible. With info like who is standing infront of it, What is written on signs, and stuff like what direction something is in. I'm not into ai that much, but what is your opinion on this?
neat!
i suspect nothing awful will happen allowing AI to code for us!
Welcome to minecraft 😊
is it possible to have like 10 or 100 of this bots in one world?
WHERE CAN I GET THIS? Will it work on a MC server?
I have a half finished project like this myself, the agent has a local representation of the world of 5x5 in layers, represented in a table, and then a list of the top 20 interesting items nearby in a range of 20x20x20. The visuals have helped in some cases where the agent gets confused, but it also leads to confusion 😅
I also agree that Mineflayer is painful. The amount of times my agent gets stuck in tree leaves (I suspect there is a weird height issue and jumping doesn't work well).
I love this project and what you've produced this far, I got demotivated early but that was with early versions of GPT-3.5 and I suspect GPT-4 would be a lot more intelligent. It's also more affordable per token now.
Excited to see what you produce with this. btw, the newAction command is a great idea.
finally, i can continue being a happy lonely person :)
The dead internet theory will expand to multplayer gamming now?
If you want to implement voice commands into the bot maybe try using the Simple Voice Chat mod for Minecraft - this mod enables you to directly speak to the bot through the game like you do with the chat.
I'm biased, but my vote goes for implementing evolutionary survival.
Also, have you tried using chain of thoughts and agents to make chatGPT come up with the orders that Andy should follow?
For example I just tried with the prompt "I just started a game of Minecraft, can you explain me step by step what should I do first to survive?" and then "I want you to assume the roles of a strategist, an engineer and a javascript coder. Simulate a chain of command on how they are going to execute step 1 of your plan. Strategist should define the goal, engineer the way to proceed and coder create javascript code to actually execute the actions. All three roles are part of the same minecraft player." and the result looks like something that could become usable.
nuh not the ai thumbnail
Plase tuturioal for bot (for aternos)
we should releases a whole pile of Andys into some servers and let nature go
it would be a bit scary if he nodded back at you and sneak like you did
Wow this is actually incredible! Most other games or mods with ai npcs have you just talk to ChatGPT but here Andy can actually do things and even write it's own commands, woah. I think you're together with Kolby pushing the state of the art of incorporating ai in games
The limitations are unfortunate, but this is already so cool and I'm excited for what's waiting around the corner
My name is Andy and I was startled when I played the video and suddenly he was saying my name.
That MC Skin is fancy
It's perfect
Definitely perfect and not causing me to get annoyed at any particular pixels
Emergent garden video! Buckle up!
This is probably something like how the Rabbit R1 “large action model” was supposed to originally work but they never figured it out! Outstanding job!
7:12 I thought the ai ragequit😂
The Jenny mod is about to get a massive upgrade
if possible could you please make a video on how to set it up because im not sure i understand
Same here. I tried to follow the instructions with gemini, but main.js keeps crashing on start. It would be way easier with tutorial.
*digs straight down* lol
So Andy is the guy from sons of the forest but better?
Hello, How can i set up the Mindcraft because i installed it?
Andy is cool, be like andy.
but he's breaking the rules don't mine straight down
it'd be cool if a minecraft challenge youtuber tried to get andy to beat the game
WHY CANT I FIND TUTORIAL HOW TO INSTAL THE MOD
1 year from now: Andy beat Minecraft
i want him in my minecraft world
❤
pls tutorial on how to use mindcraft