AI controlling a character in World of Warcraft
HTML-код
- Опубликовано: 7 янв 2025
- This is a little project I've been working on to allow an LLM AI to take full control of it's own character in World of Warcraft. I'm still early in development, but this project is mainly just for fun!
Thanks for all the great feedback! I had a lot of fun working on this. I'm thinking of making another video to dive deeper into how this works. Let me know if you'd like to see more!
Nice project, well done
@@koyot9797 Thanks I appreciate it!
Actualy its not bad idea if its not for botting ofc. Blizz can use this project to create npcs that can guide new players or for example use this smart npc to spot players that are not real player but bots and report them to blizzard. Its like AI GM lmao
i would love a deeper video into how it works. Really fun and interesting project!
I would love to see how this was developed
I'm embarassed how long it took me to realize your character name was Hehe, not that the bot was just programmed to do an annoying giggle.
BRO SAME
Wouldnt have noticed if it werent for this commemt
Me too... hehe 🤣
At least you noticed it before reading this comment.
omg! lol, not until your comment did i realize it.
Already better than most classic players.
LOL
Retail Andy is that you?
As a Classic Andy, BIG true.
@@TruckingBritainit’s true kid don’t cope
Retail players trying to stay relevant LMAO
This could be the future of NPCs for a modded WOW realm, imagine running in to a talking walking guard with its own personality
I'm thinking the same thing, it could add so much more depth to MMO worlds
@@JohnSteinmeyer as long as they never become self-aware and sentient. Imagine if the ai thought it was truly alive and begged for their life as you attacked them.
Yea man and then some npc's travel to other cities and regions to trade or maybe just to move there and they can tell you their story
@@Cold-Blooded-Jayif they became self aware they would probably become the BOSS of the expansion
@@dentistirl987 Imagine the possibilities, jesus christ. Some renegade stormwind guard going off-script and becomes some final boss lol
900 billion currently online.
Finally i don't need friends to play WoW with somebody, and it's totally adapts to my schedule!
This is already a thing, single player project or azerothcore with playerbots module
@@FizCap How well does that work?
@@balfouriking it’s pretty good, they can do all dungeons, most raids, they can do pvp battlegrounds and roam the world map
@@FizCap Oh man, I kinda wanna try that. Raiding Naxx and Ulduar with 24 bots would be awesome haha.
@@balfouriking Yea it's not perfect but it gets daily updates which is nice, there are tutorials how to set it up
This has insane potential for Players, Blizzard and for Botters
You don't need this for proper AI for "player" character that could do dungeons/raids with ya. You can script them and they will be quite good.
Limitless potential. Will most certainly be used for evil.
Players? This will be used for botters and inflating numbers. Nothing else. This is pure poison for an mmo
@@22aarauer22 don't be so negative. Imagine the NPCs being able to interact with you this way. It would be quite nice for a role server.
@akiyamach no, leave this ai trash out of mmo's. The community is supposed to be the rp, not the npc.
"Follow that northshire guard"
Wolly: *QWSEQSWEQWSEQSWEQSWESQWSEQWSQWSEQWSE*
looks like pvp
The next big mmo will be about how to differentiate bots from players
We are already in an AI world full of bots, it's called life
go work your 9-5 bot beep boop beep boop
this is good , immagine the next big mmorpg with AI quests implemented and a whole new system with AI programed to act like real merchants/thiefs/guards. Damn...it's insane
And people will stop to live normal lives, they will all be like this AI bot here…
This bot is more alive than the actual average wow players, nice
It can even use regrowth as a mage, truly hacked the simulation.
I wonder if this is a weird private server of some kind.
@@shestewa6581 Of course
@@skorpius2029 I wasn’t 100% sure if it was one of those mixed private servers or maybe just a legacy MoP one. I remembered that mages could get Druid skills in MoP. Where I thought they got rrgrowth but I think it was healing touch.
@@shestewa6581 ???
@@AFX_______I am not a mind reader. Three question marks do not a question I can answer make.
This is actually kind of insane. Imagine games in the future where you have an AI companion like this.
Blizzard has been experimenting with followers since Legion, and now in Dragonflight we got Follower Dungeons, with a team of quite "smart" NPCs playing almost as if they were human players. Yet, they're not full AIs like Wolly.
I think, once consumer-grade hardware AI accelerators become available as standalone add-in cards or integrated into CPUs or GPUs, we'll see games in which the player's own character will be able to imitate the player's real voice, and NPCs refer to him as the name chosen by the player, and not a generic one. This, and of course have fully AI-driven companions.
World of Warcraft won't be benefitting from this as it would be prohibitely expensive for Blizzard to implement an AI like this on EACH realm and make it available to every single player. Just think about how expensive is for OpenAI to run ChatGPT today.
Where I see this being an absolute success is on future editions of franchises such as Dragon Age, Elder Scrolls, Mass Effect, and The Witcher, to cite a few. Of course, it'll depend on the availability of consumer-grade hardware AI accelerators in the future.
this felt like one of those silent movies about animation in the begining of people showing this new form of film, felt a chill seeing this
In the future i imagine ai will allow anyone to go back and try old mmo's with that behave just like people and you can befriend them. Almost like a muesum for MMOs
Reviving dead MMOs with AI that roleplay as adventurers would be awesome. You could run it on a private server and get to experience what it's like to be in a lively realm full of people.
Honestly I think it'll be great.
Here before asmon
lol
Same
everyone hates that horseteethman
@@kramer1916 More people don't give a fuck about you than him.
im playing wow classic right now and since im low level i cant find any dungeon groups, this could fix that problem
This is sad, we are doomed…
Retail is already has AI companions in dungeons. It was just a limited test in the current normal DF dungeons, but I wouldn't be surprised if they use the tech more in the future
That would be so nice for new players, you could have your personal assistant while travelling!
warbands
the great wow expirence was you need to assistant you self and dont let a ai do anything for you.
For better or worse this might be the future of the game. I guess fake players that interact as humanlike as possible is better than a dead world full of silent bots.
perfect for playing wow in a doomsay apocalypse when there is no internet
I think that a swarm of these would be an awesome addition to WoW Single Player Project!
...and a scary development for private server owners...
So glad to see somebody doing this. Imagine how awesome it'd be to have an entire realm with unique "NPC players" like this that can interact and roleplay with you (and even each other to some extent). You can give them unique personalities and backstories which influence how they speak, respond, and act.
Awesome work!
For a long time I've been thinking that this is the pinnacle of potential for RPGs. A game where you can actually talk to NPCs. Now just have this work with voice input/output and you got an incredibly immersive system going.
i want this bot as a druid with windfury rune chasing me on my pala
Imagine a server where every npc behaves like this, like you can just go up to thrall or sylvanis and convince them to join you, along with an army of guards to go storm ironforge or something. So much epic sandbox potential!
world of diplomacy
"guess we gotta fix some glitches in you lol"
"Haha, I guess so!" meanwhile existential crisis
Azerothcore with a few thousand LLM bots would be insane
Imagine the API cost lol
@@speldritch
With a good PC you can run AI locally, it's slow without a lot of vram but decent enough for this use case. Future hardware will be designed with AI in mind I'm sure, so give it a few years and it'll be quite reasonable to do all of this without any cloud services required.
You only need the AI to generate messages that you can hear, so bots in other zones need not speak.
Keep going with this project. This could change MMOs forever!
Commenting because I’d really really really love to see this and set it up especially on servers where players die out
Honestly, with how frightening ai is getting, this is impressive and makes me curious on the behind the scenes for this
When a single individual making progress better than a megacorporation
bro made a veridian gate companion npc
Nice hearing that Elwynn music! Sends me back to when i was questing with Bert.
More personality and cooperation than the average sweat who populates the game
That was a Fireball. Impressive though!
I always assumed that people would eventually try this out, just didn't expect it on WoW of all things. This is really cool!
Can you run to goldshire inn, have a look around and report back to me?
I hope this can be integrated into Single Player Project
The moment the bot spazzed doing 50000 apm, i bet it got flagged real hard on blizzards bot-radar
Mage casting Regrowth...? Seems legit!
If this is a real AI, colour me impressed! I, for one, think AI are a wonderful tool and I can see so many ways how it could help games like WoW and add to the experience! Thanks for sharing.
Finally, a friend I can play with. #bee
He added an interface to an injector to take json input for commands like follow. Or scan nearby targets. Go to coordinates of this target name. Then feed llm his prompt to convert text to json which is sent to his bot
This in a repack or something would be amazing o.O
dios!! my man!! this is amazing!!!
Glad you like it!
@@JohnSteinmeyer is there a way to add this on a private server? why privates dont haves this?
@CcsRespira Absolutely, in fact I set this up and ran on a private server. I'll put together another video explaining more how it works
@@JohnSteinmeyer im working on my own private proyect but for latinamerican community, is there a way to contact u to learn more about this feature? for me is amazing
@@JohnSteinmeyer I hope this can be integrated into Playerbots, AI in Single Player Project would be amazing!!
this might be a gateway for mmorpg's in terms of story driven gameplay
like mark this day forward if this thing evolves we gonna see amaaaazing shit
Absolutely! As the cost of running these models continues to drop developers will be able to use them for things like this on a wider scale
@@JohnSteinmeyer How demanding are these models to run?
@@konradbrochocki4923 VRAM is everything with running these models. Having a RTX 3090 or 4090 with 24GB of VRAM would allow you to run a pretty smart model that could be trained to work like the one in the video here
@@JohnSteinmeyer I have a 3080ti with 32gb of memory. Would I be able to use my my machine for anything else while it's running though?
Edit: sorry, the 3080 ti only has 12gb of vram. I see why you suggested those other cards.
@@konradbrochocki4923 The quality of smaller models has been going up a lot recently and even with 12gb of vram you could still use something like Llama 3.1 8B and get good results
Jesus christ, we're getting closer to doomsday
And people think its cool, were fucked lmao
I hope this is a joke...
I mean it is cool but the implications are potentially world ending
Pretty much sure that guys who burned alive scientists hundred of years ago cuz "they are the devil followers who bring closer the dOoMsDaY with their magic tricks" were thinking in kinda similar ways
@@hkgoalie91 don't be silly the AI will never become independent like in the movies. you watched too much science-fiction.
id use this on 2 accounts and tell it to follow me and heal me when I get low
Finally someone that can carry me through Arena
to be honest i'd rather live a life full of very smart, useful, uncensored and limitless AIs bots/partners that let me do everything i want like a lucid dream, than living with other people
Earned a sub just to keep up to date with this. Looks promising and exciting!
Now make me a model that follows me around as a druid with windfury in stealth and then heals me when I take damage :)
Got a git repo for this project? Been thinking about setting up a wow-server with AI bots and seeing how they learn wow.
Dude, this is insane! I was dreaming about this few weeks ago. Is it possible to add to use your technology with PlayerBots on AzerothCore server?
I already fear the World when you cant tell a bot from a human apart
Could you teach how to do this? Or at least exchange texts with NPCs or NPCbos? I'm trying with koboldcpp, it gives some errors, I need some tutorial because I don't know how to program but I really like trying these things.
Honestly your best friend for helping you with this is AI. I would use chat gpt 4o or claude 3.5. They're great for programming/resource gathering.
@@JohnSteinmeyerI made the npcbots talk but I'm not sure how they can move it's still very funny I'm having a lot of fun with them
"OK, LETS BLAST IT" made me laugh so hard dude lol
Multiboxers going crazy trying to get this rn
playerbots are already a thing
only thing why you know its not a human is wrote back without thinking.
This is the real life example of how do you kill that which has no life
What's the foundation model?
pov: my dungeon group
I wanted to try something similar. How is this done?
great job, it´s amazing!
3:43 how can a mage cast "Regrowth"?
local run private server
I'm glad you took her to Stormwind, since going to Stormwind had been her only dream since childhood. (Probably)
give the command: dont do anything i say for a whole year
Great work. I wonder how you achieved it. Did you use, for instance, TrinityCore and NPCBots?
"Just for fun" today
Replacing raiders tomorrow :P
Wow this is a great feature, I always wanted to play with an lA
Tbh this mage guy looks like the perfect 2s mate
the bots on era servers could never
Probably need to call them by their names if there are more than one in your vicinity
ahh I thought the bot would find its own way to Stormwind
Awesome, true solo WoW experience. I like it!
The problem is how good they are in raids. I hate most of bots doing terribly in MC, BW, Naxx. They can only assist you in quest and pvp.
And somehow guild isn't a thing in solo wow because those programs are tedious as hell. If the personality problem can be solved, then we will get ultimate experience in solo classics and truly don't need other real people anymore 😂.
It would be cool if it started questioning you and asked you to follow it. Also it needs to jump around like a real player or randomly attacking stuff because it's "bored" when it can act like real humans it's gonna be insane.
I don't think this is real because the AI gave sometimes an answer pretty much instantly. As far as I know there's always a delay of 2-3 seconds.
local language models exist
it depends of the prompt you give him.
Simple basic prompt = fast answer
Difficult prompt like ask which mobs are nearby = long answer
@@levonschaftin3676 they also have a short delay
There are literally moments where the AI needs time to answer... I guess you only watched like the first 20 secs?
I wonder how long AI can last on Halo ODST ending mission 🤔
Soon they’ll beat halo 2 on legendary….
THAT is awesome. How did you make language model to know how to follow you avoiding obstacles
Cool! I would like to see some deep dives about it! What model did you use, how you trained it and so on!
It’s you own private server, right?
this is fucking hilarious and scary same times. Reminds me about oblivion npc converstion memes
🤣
Dude that’s so cool
Great job John! How do you capture all the interactions (chat, environment, etc) ? Sniffing, memory or computer vision?
Thanks @igorpwn Since this was done on private server I didn't have to rely on sniffing/memory editing/computer vision - as I could develop scripts server side to provide the LLM with the information it needed to experience the world.
Откуда у мага регрос?
LFR can finally be completed in a decent manner.
We got pawns in wow before gta 6
i would like to know if theres a place where this can be obtained or copied
Damn. I wonder if you could have your own private server with like 100 AI bots to help you raid and such. Basically single player WoW.
So it can acces all the spells... Okay... AI arena partner incoming...
I would love to see more. I have a locally installed LLM on a computer, but I could not get it to interact with anything on the system it was installed on. Did you use a different type of AI? I don't know a whole lot about this stuff at this point.
I already hate how in many games, the devs purposefully make their bots as indistinguishable from real players as possible, because i feel it negatively impacts the community and my online experience. I play online games to interact with real people in a fictional setting. If I wanted to play with or against computers, I would play offline.
Plus, the implications this could have on catching and banning botters, gold sellers, and cheaters could make it nearly impossible in the near future. Or maybe not, if anti-cheat systems are simultaneously improved by similar AI programs? Idk.
This tech can do great things if used to improve immersion in the game world and enhance player interaction, but it can be detrimental if it starts to replace it.
Looking forward to updates on this project. Do you have it on github?
I would want to see this on private servers
This video is on a private server
this is both impressiev and concerning
Impressive work! Unfortunately with the growth of AI will come many more bot problems to wow lol
It would be cool to have your own private persistent server full of AI players.
@@hkgoalie91that’s the goal of some of those who work on the single player project. Someone been recording all server actions on the old classic versions decades ago, they will try to implement it to recreate the game and its players in the state of the mid 2000s
@@first001
Is the WoW Singleplayer Project still kicking? Cool, I remember trying it out years ago. LLM integration for player bots would be incredible.
If Wolly is a mage, how did it cast regrowth?
This has massive potential for gold farming on Moon Guard.
It’s all fun until an AI starts getting pink parses and you aren’t lmao