I actually just did a full playthrough with this bot and had it beat the ender dragon at the end. As a developer myself, this amazed me tremendously as I was blown away by its capabilities after jumping into a game with some serious doubts hahaha. For the people who want to beat the ender dragon together with the AI, I recommend making a change in the code to stop it from attacking enderman and also give it a pumpkin head so that it won't accidentally trigger enderman by looking around. It won't be able to equip the carved pumpkin head immediately. This also requires a change in the code. There is a section in the code that checks for armor pieces to equip in the right slot.. you just gotta add an additional check for the carved pumpkin item to allow your AI to assign it to the helmet slot. Those 2 changes make it fully manageable in the End.
hot damn, those background bits of the new claude + cheat mode were awesome. even the lopsided house was pretty neat, but that castle + courtyard was just... wow!
What the heck? You are an amazing person. Just handing out stuff you worked hard on for free. It's people like you who make the world a better place, take all the time you need. You deserve it.
I think you are mistaken. This isn't an install that requires a developer, it just needs someone who is old.... Um, like me. :D My masters work was in AI about 30 years ago. (Literally.) I'm truly amazed by the advances that have been made. I never would have imagined being able to play minecraft with an AI. At the time, we were having difficulties getting a good game of Go. What you've done here is amazing. I really appreciate you sharing the video and the project. Thank you. You rock!
The feeling that I got when you said that "this is for developers" on top of the "won't work on mac too well " made me realize I'm going to have to wait a bit longer before I can try Mind Craft. I love what you have done. well done!
It’s really interesting seeing the tech stack that people from other areas in the AI space end up choosing. I do a lot of lower level programming in actually running AI models on hardware (ie: CPU AVX programming, GPU kernels, high performance networking, parallelism strategies, etc), and when you said “first we have to install node” I must honestly say I though in a moment of abject horror that you had re-implemented llamaCPP in JS to run local AI models for this project, lol.
4:25 I recent trick I learned. Instead of having to change directories with the cd command, you can directly open powershell in the desired folder. Open said folder in the File Explorer, then click on the textbox with the path (what gets copied in the video) and just type "powershell" (without the quotes) and hit enter. Powershell will open in the currently selected folder. The same works for the Command Prompt, use "cmd" instead of "powershell".
2:00 "Hide extensions for known file types" is enabled by default, you must go into the File Explorer settings and turn that option off if you want the `.json` to not be hidden.
I love seeing these whenever they pop up on my feed. Just the potential to be like " 1 person digs every stone and dirt in the spawn chunk, 1 person plants and chops trees, 1 person crafts picks and ladders" and then just go to bed is so much better than building a flying tnt duper
This is fantastic. Your explanation of what an API key is, is wrong though. It doesn’t necessarily have anything to do with whether or not you paid. They want to know *who* is accessing their API, for rate limiting, anti-DDoS, level of access, etc. I would say most APIs are either closed to the public, or open to the public and free, not open to the public and paid.
this is something that confuses me a lot: is there any way to play games with GPT ai without paying fir an API key? like, by just getting a key for free?
@@hanjxoe I got one for free when GPT was starting by being an "AI developer", also Claude gives free API some people said (though it is limited by minute rate and Claude is the worst of the bots)
I just want a bot that can play the game with me, like a friend. But it will take a while before the Ai will be able to do that. I'm happy that things are moving.
I'm a full-stack developer, and the way you unpacked your instructions was really excellent. It understands so many of the pain points of the layperson. Really excellent.
just as a heads up, i needed to change my powershell execution policy was set to restricted, and I needed to change it, i think you should instruct others to do the same as running the commands in powershell do not work unless the powershell execution policy is set to unrestricted
Tip: You can quickly and easily run powershell in whatever directory you are in by going to the address bar and typing in "powershell". If you have less time on your hands or if you are feeling lazy, you can type in "cmd" instead to open command prompt in the current folder you are in. Hope this makes life for some of you easier like it did for me. :)
@ I had this same issue when installing on Windows. In my case, it was expecting a newer version of NodeJS. I removed the repo, updated NodeJS, then tried the installation again. Your case may or may not be different. I would recommend looking up the error message and deducing what is wrong.
I've done everything like in video, but there's some error at, like, 5:15, it just writes something like "error_module_not_found" and "did you mean to import debug/src/index.js" how to fix this??? is it happens because i have pirated minecraft launcher (in my country i can't buy one...)?? or because i used novita ai (other ones either banned in my county, or i just couldn't figure out how to use these)?? (and sorry, im not native english speaker)
While I don't think I'm doing anything special at all I think it's really amazing that I can understand this tutorial only because of having to build many servers over the years for MC across different OSs for play with friends. Just learning what I needed and could myself online.
0:41 So what you're saying is that its in the works for bedrock edition? Or is it just a future thing? You said "Yet" and i really want it on BE because i dont have a computer
I wonder if this would work with Neuro-sama's LLM. Neuro-sama is a popular VTuber who is an AI. She was trained from some of her VTuber friends in order to be as entertaining to chat and for the collab partners as well. Would be fun to see what she does with Mindcraft if its possible to get her hooked up
I don't see why not. In fact, I think this is the exact project that he's using for his recently announced "upgrade" to Neuro minecraft. It seems that Neuro's LLM only need to express actions with natural language via parameterized commands, so whatever model Vedal is using should be sufficient, doesn't really need the larger coding models to create custom action with JavaScript. 12:30 Although I have to say that I DESPITE Vedal man... Really so many improvements to Neuro is because the opensource community and he not once mentioned any of them. Flash attention, KV cache, whisper turbo / faster whisper, quantization techniques, all the amazing llama, mistral, qwen models, all the effort of the LLM finetuners. This does not educate the swarm about how system like Neuro works, does not give any spot light on the works that other have done, and also make Vedal seems like an amazing programmer even though he's incredibly mid. (not attacking his entertainment value because he's legit pretty funny) Really really dislike how Vedal do his Neuro "upgrade announcement". Always extremely surface level and fluff, "I made Neuro smarter", "Neuro can now remember more", "Neuro latency is now lowered", literally never give any spot light to the people who actually engineered the improvements.
Is there a Discord, or can you add the Discussions tab to the repo? I have questions about what parts of the code are controlling what, and how I can "teach" it things.
Oh man, how do I set up in my server. I am not good at js afterall. I remember I tried to learn discord.js , it went horribly wrong. The code never worked.
i put the api key i got in the open ai api key thing in notepad but it still says 'API key "OPENAI_API_KEY" not found in keys.json or environment variables!',
There is something I don't understand about open source, if someones wants to contribute, unless they are in the original team, is it gonna be a fork or do people usually contribute to the main project?
Hello Emergent, could i contact you somewhere to give you certain commands that should be prioritized in them? I saw the previous video, they were very dumb, so i would like to help fix them.
Is it possible or practical for these Ai models to control multiple entities? Say if you wanted to create a civilization of entities that were self replicating. Would you need a different Ai model or api for each new entity generated?
Hey @emergentgarden, have you seen anthropic's MCP? Do you think this will accelerate progress towards a bedrock version? Even help with the project itself?
I have a problem. Andy spawned and reacts to my commands, but I can’t see his response. They appear in Powershell but not in the game. Thanks in advance for the help 🤕
wonder if the Qwen 2.5 32b coding model is good for this. Supposed to be close to 4o when it comes to coding and IQ4 fits relatively nicely in 24gb 3090
I have ollama running llama3 already, it says to just have ollama installed, which is nice, but after that i get an error in the cmd when i try to run the node command. I would appreciate any help given or advice.
Is your ollama included into PATH? If you open cmd or powershell in random folder and write "ollama" there, does it return ollama help text or just writes that file is not found?
Compared to the last video I just watched of you and Kolby demoing the bot for the first time, this thing turned into a damn GENIUS compared to what it could do last time. Last time it built a cobblestone "house" and that was the best it was able to do from what I saw. It definitely looks like it has gotten better at writing its own code, and got better and understanding building mechanics as well. Well not sure entirely about Andy, but Claude, holy shit he can BUILD, that was honestly an epic looking Castle for an AI to make up on the spot, instantly. Genuinely gave you something you could work with. But here's the real question, how well can Claude build on a non-superflat world? Can he do just as well on a regular world? Biggest question if anyone sees this... Are ANY of those API's free to use? I'm not getting 40hrs a week anymore... Struggling to make things work OK with just 22-24hrs a week at work. Was doing just fine at full time, then they go and hire 3 people and 2 of them are fucking useless...
Your API key may be wrong, check whatever company you purchased it from and see if you have paid, or if they have a free one (like gemini, but it’s really bad)
try with the new gemini 2.0 it was trained to be more environmentally aware, though that is for vision stuff like images and video. I wonder how much better it does with this mod than before
I want to use Replicate ai model, how to do it? Ah, i started to use it, but in every model bot starts to answer my commands, but next he typing "my brain disconnected. Try again".
God this is really happening...it's literally my dream to play sandbox game with AI when I was a kid. Random players are so hard to deal with and friends don't always have the right time. Don't know how long it would take to get AI work on more versions or even forge mods..... doubt I would live long enough to find out. 😂 Nonetheless, thanks for the work, bro.
i get ''my brain is disconnected'' error on chat gpt
Месяц назад
a node ai backend? Hmm i guess that works but I recommend a c# server with an api interface and then javascript style comms from client to server. Server handles speaking and interacting with the bot and keeps track of the interactions. I can see some limits to why you may have chose that though. Best of luck
![BLACK BAG - Official Trailer [HD] - Only in Theaters March 14](http://i.ytimg.com/vi/Du0Xp8WX_7I/mqdefault.jpg)
my parents used to call Minecraft "Mindcraft" who knew they were predicting the future
Canon event ☠️
Mine too lol
Dude my little cousin said that too I think he saw future 😂
my parents still call minecraft "Mindcraft"
Omg yes mine too
Finally, I can pretend that I played Minecraft with friends instead of befriending the villagers and having an imaginary conversation with them
Yes especially when you have no friends 😢
DanTDM:
YAYYY
this is gonna make a LOT of youtubers very happy lol
Slop. Incoming!
@kreekkrapalready starting to see it too, terrible content posing that this project is their own
fortunately I know where to find Emergent Garden ❤
I actually just did a full playthrough with this bot and had it beat the ender dragon at the end. As a developer myself, this amazed me tremendously as I was blown away by its capabilities after jumping into a game with some serious doubts hahaha.
For the people who want to beat the ender dragon together with the AI, I recommend making a change in the code to stop it from attacking enderman and also give it a pumpkin head so that it won't accidentally trigger enderman by looking around.
It won't be able to equip the carved pumpkin head immediately. This also requires a change in the code. There is a section in the code that checks for armor pieces to equip in the right slot.. you just gotta add an additional check for the carved pumpkin item to allow your AI to assign it to the helmet slot.
Those 2 changes make it fully manageable in the End.
end pun hehe
any way you could get it to play bedwars?????
@@pleasntly maybe a private bedwars server, but not hypixel
@@proatplanes yeah thats more what I want to do, with friends yk
hot damn, those background bits of the new claude + cheat mode were awesome. even the lopsided house was pretty neat, but that castle + courtyard was just... wow!
What the heck? You are an amazing person. Just handing out stuff you worked hard on for free. It's people like you who make the world a better place, take all the time you need. You deserve it.
The patience to explain everything so clearly was outstanding
I appreciate the fact that you are honest and set boundaries with people
Finally! On the discord server I proposed this idea to you and you did it! Thanks, you're awesome.
You have no idea how happy i am that you're back uploading, I LOVE your videos
if you don't want to pay, Gemini has a free one (12 requests per minute max).
what about groq
oh thanks
Thanks!
I think you are mistaken. This isn't an install that requires a developer, it just needs someone who is old.... Um, like me. :D
My masters work was in AI about 30 years ago. (Literally.) I'm truly amazed by the advances that have been made. I never would have imagined being able to play minecraft with an AI. At the time, we were having difficulties getting a good game of Go. What you've done here is amazing. I really appreciate you sharing the video and the project.
Thank you. You rock!
Came here from a Kolanii vid and I have wanted to try messing with the capabilities of an AI in minecraft and this is the perfect, thank you!!
The feeling that I got when you said that "this is for developers" on top of the "won't work on mac too well " made me realize I'm going to have to wait a bit longer before I can try Mind Craft. I love what you have done. well done!
It’s really interesting seeing the tech stack that people from other areas in the AI space end up choosing. I do a lot of lower level programming in actually running AI models on hardware (ie: CPU AVX programming, GPU kernels, high performance networking, parallelism strategies, etc), and when you said “first we have to install node” I must honestly say I though in a moment of abject horror that you had re-implemented llamaCPP in JS to run local AI models for this project, lol.
LOL if I ever try to do that you should put me out of my misery
@@EmergentGarden Is it possible to make it join a lunar client world?
that... would be unimaginable levels of pain
Ive been waiting for a turorial on this for months now!
4:25
I recent trick I learned. Instead of having to change directories with the cd command, you can directly open powershell in the desired folder. Open said folder in the File Explorer, then click on the textbox with the path (what gets copied in the video) and just type "powershell" (without the quotes) and hit enter. Powershell will open in the currently selected folder.
The same works for the Command Prompt, use "cmd" instead of "powershell".
GENIUS! I was having an error with cd, Thx!
It gives me another error message when I try to run npm install even after i copied the file link, how do I fix it?
The project is really amazing and i can't wait how you're going to improve in the upcoming updates
2:00 "Hide extensions for known file types" is enabled by default, you must go into the File Explorer settings and turn that option off if you want the `.json` to not be hidden.
I love seeing these whenever they pop up on my feed. Just the potential to be like " 1 person digs every stone and dirt in the spawn chunk, 1 person plants and chops trees, 1 person crafts picks and ladders" and then just go to bed is so much better than building a flying tnt duper
This is fantastic.
Your explanation of what an API key is, is wrong though. It doesn’t necessarily have anything to do with whether or not you paid. They want to know *who* is accessing their API, for rate limiting, anti-DDoS, level of access, etc. I would say most APIs are either closed to the public, or open to the public and free, not open to the public and paid.
Simplified explanation for the layman
this is something that confuses me a lot: is there any way to play games with GPT ai without paying fir an API key? like, by just getting a key for free?
@@hanjxoe I got one for free when GPT was starting by being an "AI developer", also Claude gives free API some people said (though it is limited by minute rate and Claude is the worst of the bots)
I just want a bot that can play the game with me, like a friend. But it will take a while before the Ai will be able to do that. I'm happy that things are moving.
genuinely one of the easiest installs of any AI ive installed. even in pre pre alpha it still works nicely
I'm a full-stack developer, and the way you unpacked your instructions was really excellent. It understands so many of the pain points of the layperson. Really excellent.
What stack do you use? I am currently learning MERN and we just started with databases using MongoDB Compass.
Is no one gonna talk how bro's time is 2:11 PM, 1/1/1980? 💀💀💀💀
This seems like a virtual machine. That also explains why he doesn't even have winrar and why would a developer have hidden extensions in files.
love the project and your development philosophy ❤
just as a heads up, i needed to change my powershell execution policy was set to restricted, and I needed to change it, i think you should instruct others to do the same as running the commands in powershell do not work unless the powershell execution policy is set to unrestricted
Tip: You can quickly and easily run powershell in whatever directory you are in by going to the address bar and typing in "powershell". If you have less time on your hands or if you are feeling lazy, you can type in "cmd" instead to open command prompt in the current folder you are in.
Hope this makes life for some of you easier like it did for me. :)
It gives me another error message when I try to run npm install even after i copied the file link, how do I fix it?
@ I had this same issue when installing on Windows. In my case, it was expecting a newer version of NodeJS. I removed the repo, updated NodeJS, then tried the installation again. Your case may or may not be different. I would recommend looking up the error message and deducing what is wrong.
oh i actually got it! one more thing, it says my brain disconnected, how do I fix that?
thanks guys, i really love the project 🙏
from minecraft ARG to being an actual mod is about to make my brain explode
I've done everything like in video, but there's some error at, like, 5:15, it just writes something like "error_module_not_found" and "did you mean to import debug/src/index.js"
how to fix this??? is it happens because i have pirated minecraft launcher (in my country i can't buy one...)?? or because i used novita ai (other ones either banned in my county, or i just couldn't figure out how to use these)??
(and sorry, im not native english speaker)
Great video :) I set it up on macOS and it works great btw, have been having a blast. This project is so cool
Wow... I don't even play Minecraft but damn this is an extremely well made guide especially for those youngster's wanting to learn. Well done sir!
you are a cool human - thank you for existing.
This sounds so fascinating! please add an android and apple version someday
While I don't think I'm doing anything special at all I think it's really amazing that I can understand this tutorial only because of having to build many servers over the years for MC across different OSs for play with friends. Just learning what I needed and could myself online.
Now if only there was a way to use the new gemini free model and change the bot skin...
Awesome vidoe! Loved how you explained everything.
I can't wait for the future, where I can force the AI to live through the events of Attack on Titan or Maze Runner
You have my support i hope this gets better!
0:41 So what you're saying is that its in the works for bedrock edition? Or is it just a future thing? You said "Yet" and i really want it on BE because i dont have a computer
can you use mistral as the api key?
damn recorded back in the 80s is wild!!
I wonder if this would work with Neuro-sama's LLM. Neuro-sama is a popular VTuber who is an AI. She was trained from some of her VTuber friends in order to be as entertaining to chat and for the collab partners as well.
Would be fun to see what she does with Mindcraft if its possible to get her hooked up
I don't see why not. In fact, I think this is the exact project that he's using for his recently announced "upgrade" to Neuro minecraft. It seems that Neuro's LLM only need to express actions with natural language via parameterized commands, so whatever model Vedal is using should be sufficient, doesn't really need the larger coding models to create custom action with JavaScript.
12:30 Although I have to say that I DESPITE Vedal man... Really so many improvements to Neuro is because the opensource community and he not once mentioned any of them. Flash attention, KV cache, whisper turbo / faster whisper, quantization techniques, all the amazing llama, mistral, qwen models, all the effort of the LLM finetuners. This does not educate the swarm about how system like Neuro works, does not give any spot light on the works that other have done, and also make Vedal seems like an amazing programmer even though he's incredibly mid. (not attacking his entertainment value because he's legit pretty funny)
Really really dislike how Vedal do his Neuro "upgrade announcement". Always extremely surface level and fluff, "I made Neuro smarter", "Neuro can now remember more", "Neuro latency is now lowered", literally never give any spot light to the people who actually engineered the improvements.
This is genuinely amazing
I love your mindset, keep doing what you do and take your time.
I see other people use this bot along with "yes steve" skin mod. How they do it? I can't make bot change player model.
It’s not that hard guys. I have zero programming knowledge and got it working before this tutorial. Trial and error folks
It gives me another error message when I try to run npm install even after i copied the file link, how do I fix it?
Is there a Discord, or can you add the Discussions tab to the repo? I have questions about what parts of the code are controlling what, and how I can "teach" it things.
Oh man, how do I set up in my server. I am not good at js afterall. I remember I tried to learn discord.js , it went horribly wrong. The code never worked.
It doesn't work for me, it tells me that his brain is disconnected, why?
i put the api key i got in the open ai api key thing in notepad but it still says 'API key "OPENAI_API_KEY" not found in keys.json or environment variables!',
Can it work on tlaucher?
hey emergent can you help me when i talk to andy all he says is "my brain disconnected try again" and i dont know what to do or anybody else can help
There is something I don't understand about open source, if someones wants to contribute, unless they are in the original team, is it gonna be a fork or do people usually contribute to the main project?
Hello Emergent, could i contact you somewhere to give you certain commands that should be prioritized in them? I saw the previous video, they were very dumb, so i would like to help fix them.
Is it possible or practical for these Ai models to control multiple entities? Say if you wanted to create a civilization of entities that were self replicating. Would you need a different Ai model or api for each new entity generated?
Oh sure, *now* you make a tutorial just a few weeks after I spent hours altering scripts and fixing compatibility issues
Hey @emergentgarden, have you seen anthropic's MCP? Do you think this will accelerate progress towards a bedrock version? Even help with the project itself?
I have a problem. Andy spawned and reacts to my commands, but I can’t see his response. They appear in Powershell but not in the game. Thanks in advance for the help 🤕
If your broke and is not a developer, I recommend altera, pretty simple to use, but only 30 minutes of play time and can’t build (as of 11/24/24)
Every time I try to start it he joins but he says my brain disconnected try again 😢
i have this problem too...
this is awesome thank you very much now i am not alone i have a friend
What platform do you play on?
@@alaneduardogoldmangonzalez3807 hi i donot understand your question
@@Bibek627 yeso i have Minecraft in ps4 and in My Mobile
@@alaneduardogoldmangonzalez3807 i have my account in my laptop
wonder if the Qwen 2.5 32b coding model is good for this. Supposed to be close to 4o when it comes to coding and IQ4 fits relatively nicely in 24gb 3090
I have ollama running llama3 already, it says to just have ollama installed, which is nice, but after that i get an error in the cmd when i try to run the node command. I would appreciate any help given or advice.
Is your ollama included into PATH? If you open cmd or powershell in random folder and write "ollama" there, does it return ollama help text or just writes that file is not found?
You are serious crazy man this is awesome
Thank you i wanted to do that for a long time
hey do you have any plans on making this a plugin for servers? My friend and I really need slaves on our server.
How far would the Mindcraft project be in a year?
Compared to the last video I just watched of you and Kolby demoing the bot for the first time, this thing turned into a damn GENIUS compared to what it could do last time. Last time it built a cobblestone "house" and that was the best it was able to do from what I saw. It definitely looks like it has gotten better at writing its own code, and got better and understanding building mechanics as well. Well not sure entirely about Andy, but Claude, holy shit he can BUILD, that was honestly an epic looking Castle for an AI to make up on the spot, instantly. Genuinely gave you something you could work with.
But here's the real question, how well can Claude build on a non-superflat world? Can he do just as well on a regular world?
Biggest question if anyone sees this... Are ANY of those API's free to use? I'm not getting 40hrs a week anymore... Struggling to make things work OK with just 22-24hrs a week at work. Was doing just fine at full time, then they go and hire 3 people and 2 of them are fucking useless...
Any chance this could work on an external Minecraft server?
I m facing this problem pls help me
Purely conversational response: My brain. disconnected, try again.
same
Your API key may be wrong, check whatever company you purchased it from and see if you have paid, or if they have a free one (like gemini, but it’s really bad)
try with the new gemini 2.0 it was trained to be more environmentally aware, though that is for vision stuff like images and video. I wonder how much better it does with this mod than before
for me it wont show up as a zipped folder it shows as winrar
really needed it bro dont go on views
I want to use Replicate ai model, how to do it?
Ah, i started to use it, but in every model bot starts to answer my commands, but next he typing "my brain disconnected. Try again".
God this is really happening...it's literally my dream to play sandbox game with AI when I was a kid. Random players are so hard to deal with and friends don't always have the right time.
Don't know how long it would take to get AI work on more versions or even forge mods..... doubt I would live long enough to find out. 😂 Nonetheless, thanks for the work, bro.
В течение года
You should try to put them in 4D Minecraft
this is so hype, i'm excited to be able to try it when it becomes more user friendly to stupid people like me
Can I use hugging face models api ?
is it possible to use FOSS ai models locally?
Okay, but why would there be problems on Linux if it's a node application?
i get ''my brain is disconnected'' error on chat gpt
a node ai backend? Hmm i guess that works but I recommend a c# server with an api interface and then javascript style comms from client to server. Server handles speaking and interacting with the bot and keeps track of the interactions. I can see some limits to why you may have chose that though. Best of luck
Hey man, any chance you can make one of your AI guys complete all achievements/trophy's in minecraft?
is that possible on bedrock?
would be cool if the bot could use litematica schematics, with internet acces it even could search the web for new builds
i cant rename the keys.example.json file
XDD i love the colby cheese joke, keep doin random jokes like dat, random humor is good humor
how to contact for cooperation?
how do I use ollama with it, its free right?
Someone know how to change the skin ?
my brain is disconnect how to fix this problem?
Can you add many ai players and make them survive?
Like AI civilization?
They're not nearly to the point of contextual understanding to properly collaborate and do anything interesting yet.
But he's working on it
I suppose it would be very costly
I suppose it would be very costly
@@SufficingPit some youtubers already did it months ago
can I use like use the free key or no?
when will 1.20.1 release for this
where is discord?
why cant i rename the file
I think it would be better if you say what is mindcraft before showing installation process