A friend and I were actually pretty skilled at doing just that in seventh to eighth grade or so. You could be talking to a kid with too much time at their hands and weird hobbies. :>
6:56 "Describe your personality in 26 words" - Upset, frustrated, scared, negative. "That was 4 words, Josh.." - ....So? You got owned there. He doesn't give a fuck. He's not boring, he just has completely given up on life.
I remember a couple of years ago the game AI Dungeon had a lot of trouble with keeping track of whatever happened prior. These NPC seem amazing at keeping a coherent conversation in comparison.
AI Dungeon was the precursor to all of the recent AI popularity; the harbinger of what's to come. It's a shame that the game is a shell of its former self-I used to have a blast messing around in it.
@@explosionspin3422 same, but i followed the subreddit for a bit; apparently the creators placed a lot of limiters on the engine, and there were some monetization issues. though supposedly the more dedicated userbase isn't experiencing any problems doing the things they've always done, it's just that the creative freedom and "pick up and play" part of it has been "downsized" (?) a little bit
@@privatepengu They used to use ChatGPT based models, and those models got lobotomized by openAI so they switched to different models and AIdungeon is pretty good now.
Wow, this is like... Roleplaying games may finally involve roleplay. I would totally, absolutely bumble through this with a cliche noir affectation like a 1930s detective and have a blast
6:57 Nope, nope, nope. That is actually frighteningly human. Josh isn't boring, Josh is just fucking *done*, having worked in a factory for a while I can say Josh is our spirit animal. That is a depressingly realistic character.
16:16 "Endless unseen islands" feels all too relatable. I really miss the young days of playing games and letting my imagination run wild. I'm honestly stoked to see how this tech can and will shape games.
Imagine being an AI npc in a video game and a speedrunner walks up to you, blurts a string of random key phrases, and causes you to finish the game for them
Or in the middle of a gun fight, during a stalemate convincing the enemy to turn sides and help you, yet have the change of them pretending to help you to get closer and kill you. This incredibly human situation happens a lot on games like rust or among us so it would be awesome to see that awkward dance of whether to trust or not happen between an AI and a human.
Looks promising, but I really hope that these AI models will run locally instead of in the cloud. Would suck to see single player stories with an experation date
There are plenty of pretty good open source models you can run locally. They're pretty easy to find on huggingface. Though, the ones that have decent intelligence and coherence are pretty heavy. You can run them on the CPU, but then they run at a glacial speed. Ideally you want to run them on the GPU, but then you need one with plenty of VRAM. You can get light models too, but in my experience, they are too dumb to be all that interesting.
@@andyasbestos Hopefully we'll be getting dedicated AI hardware, even if the trends are to move everything to cloud. Another possible improvement I see is specialized AI models trained only using the set of data strictly necessary to perform its function. Like, a model trained to act out a specific NPC
16:50 This unlocked a memory.. I was watching someone play this game and every time they tried to get to this island something bad happened. I remember the fairies and them being super uncooperative and some puzzle doors, and the long garden..
Josh is the most believable of the bunch. Like, the one who did the poem for the asking of it, doesn't come across as anything like a real person, but more like chat gpt. Josh doesn't care about your questions, and is annoyed he's being inconvenienced. He has a terrible, demanding job, and doesn't have time for his own pursuits, and now a detective is asking him irrelevant questions, when he just needs to get to work to earn his living.
It would be hilarious if in future games, you can scare NPCS to leave the scene using a similar method you tried at 15:30. Like telling them the building they are in is on fire and watch them run out only to realize you lied to them... all without having to be scripted.
My best friend spent a few years of her life completely stuck in Skyrim, she was so shut out of the real world that she recognised the NPC's as real people, and even still to this day feels strong emotions if one of the NPC's she was "close" to is killed, even if it's not in her game, and that was with Skyrim level NPC's. I absolutely love this technology, and the possibilities for NPC's in the future if gaming took this path is endless, however I think it's really important to consider the real world problems this could potentially cause, not the "AI will turn evil trope", but the connections people could end up forming with characters that could potentially replace human contact, something that isn't healthy. Imagine if Skyrim had this level of AI, but with a better speech model and more polished in general. I genuinely fear that some people may completely replace human contact and catch real feelings for NPC's within the game, something that isn't healthy on it's own. Now imagine someone who does this decides to marry a character, and over the time of their save gets to know all of their likes and dislikes, like how they love mountains but hate heights, or how they love red apples more than green ones, just stuff the AI randomly generated and saved into your game file for that character. Then one day that persons save file is corrupted, and they have to start over, that character will be different this time around, it will have the same backstory and lore that the writers have created, but nothing the AI generated, to that person if they are genuinely tricked into believing this is a replacement for real human contact, they have just lost their wife. It could literally drive people insane. You might think this is unrealistic, but again I have seen this already happen in the world with gaming, and I fully believe if Skyrim or a game like it had perfected this tech, my friend would never have gotten help. I genuinely would love to see RPG games with REAL characters, but I think this is a topic that does need to be seriously considered before it can ever be carefully implemented into real games.
There are already people who prefer to chat with an AI chatbot than real humans, I've learned about it thorough louis rossmanns channel where he recently talked about it.
Fear not, it already happened. There were some news recently about an ai chatbot service for romantic purposes that changed how the bots worked after a while and people were furious. Google "replika ai scandal" or something along those lines.
Honestly a lot of modern communication is not healthy. You need good conversation, good people. Without healthy people around you, you're better off with an AI anyway. Currently AI isn't there yet, but I don't think this is a negative. It'll certainly be healthier than trying to hold a conversation online 90% of the time.
That exciting feeling that there might be lots to explore in a game is one of the best feelings. I got that feeling when I played INFRA, a Source-based story driven puzzle game. It has such an open and detailed world with several pathways through a linear story, with lots of secrets, that I felt like I could go anywhere. I could interact with everything in the world, and I truly seek that feeling again in a game.
this is unreal, i cant belive how far AI has come in such short time. imagine if they had a whole body script or model that lets them freely move however they want at their own will. they could get super deep with this like if their age sets restrictions on certain parts of their body for movement or even damage taken, i feel like even for the character you are playing it could affect your gameplay
The adventure game section really sent this video home. That curiosity is something I deeply miss with gaming. You’ve officially cranked my interest in AI and video games.
I thought about that too. That would be really fucking awesome, having different personalities and some people getting angry or scared of talking to you, having to lie to them just so you can get info out or threatening them. Seems like a thing that NEEDS to be added there.
They need to ditch all their fancy lighting and whatnot to make overhead for this stuff. Who cares if the pixelated world is slightly more reflective! Give me performative npcs!
it kinda still can happen lol, just allow an AI NPC in the code with war crimes and gets triggered with a specific event or if told to? you can kinda still give an AI NPC a personality
I loved them calling you out for the tediously long name, and the only character to pronounce it in its entirety was a cripplingly grandiose megalomaniac 😅
It's funny how this is the second thing I've seen this week that I said would be cool 2 years ago only to be called an idiot for because I "didn't understand how AI worked". With AI writing and voicing dialogue, helping animate models, drawing landscape textures and models, and helping create large numbers of variations for natural looking effects, it looks like game design is being streamlined at a pace that finally exceeds the increase in complexity.
What an interesting demo. Talking about Kings Quest, one day there might be an AI that can seamlessly add new locations to a game that no-one has ever seen before... keeping the mystery. By the way, love that updated music you've been using.
I thought about the possibility of implementing this into TES6 but had my doubts since Bethesda is not known for pushing technical boundaries. But since Microsoft owns them now they could just make them do it like they did with Bing. It would be one hell of a marketing tool.
@@Dionyzos True, but they are probably way too far into production to be able to add it now. I'd imagine you have to design your game from the ground up with AI NPCs in mind, and you have to do a lot of testing beforehand to figure out the limits of what the technology can currently do.
@@pentapa3923 TES6 is still in pre-production seeing as their next game, Starfield, is still in full production mode, so it'd be possible to implement. Todd however has said previously on a podcast interview on the topic of AI voice generation that having the voice actors is very important and they add so much to it. The technology is growing rapidly thought and assuming they create DLC for Starfield which could take a year then full production for TES6 would start in about 17 months, by which point this technology could look much better, who knows.
YES AI controlled NPC dialogue is FINALY here! Ive been dreaming about this for years. This is the future of gaming. Fine tuning and more refinement will inevitably make AI controlled stories, reacting on what you do rather than scripted events. Like RPG's
Immersion and realism is the holy grail of gaming, and this is a massive step on a new road towards said holy grail. Imagine a game as expensive as Skyrim with all of the NPCs being genuinely meaningful. Having a dynamic relationship with your companions even. Wow
I feel like we've just gotten glimpse of what games in the future may be like. Imagine RPGs where YOU control your dialogue and characters respond in realistic ways. That would be gnarly
I just saw your ArmA Reforger video. You've seriously gotta check it out now! We've got 5 different helicopter mods! RHS mod, Javelin missile, tanks with tracks! Tons of gun mods!
Oh my god this is so freaking cool! It reminds me of those voice commands that swat 4 has and when I would debate chatgpt on deus ex and system shock and whatnot lol, I can already imagine so many cool concepts with this!
@@hi_its_jerry This is gonna have the opposite effect. The current TTS solutions haven't even approached the uncanny valley, let alone surpassed it, and are uncapable of expressing emotions (as far as I can tell), meanwhile Unrecord has a lot of angry shouting
I think bioware style games will always work best with hand crafter characters with well written personalities. For random npcs though, or more open rpgs like bethesda is known for, this tech would be incredible once it matures.
We agree that great writing is key for certain games. Our tech allows for scripted lines to be used with event triggers or in line with player intents so that you can have characters say key dialogue that pushes the game narrative forward -- and also be able to ask them anything while having them respond in character. Plus, we can make the scripted dialogue non-repeatable and you can have the character wait until the right point in the conversation to say the scripted dialogue. So, you get NPCs that don't repeat themselves or randomly blurt things out.
@@inworldai ok, that's actually pretty cool. There's always a certain level of sadness when you finish a game like mass effect and know that you've heard all that anyone will ever say. This would effectively solve that. I assume the scripted elements would also be able to have actual voice acting too? That's another thing that AI might be able to do convincingly, but not with the same depth or meaning
@@existentialselkath1264 It would still use voice models but game studios can use their own voice actors to train their models. Our tech has an emotions engine that changes voices based on the emotion an NPC is feeling at any time and there are other pretty advanced voice AI models that you can engineer to use with our product like Eleven Labs.
I think of wandering through the woods in an Elder Scrolls game and being able to ask questions like "which way is it to town?", "what time is it?", "do you have anything to eat?". I can envisage a future where voice actors are hired to train AI voices rather than perform the lines, but that's probably quite a lot of tech to have running in real time.
Regardless of any downfalls with AI chatbots, when it comes to the immersion of seeing something actually react to you, this still seems like an objective improvement over a typical NPC that doesnt have any perception beyond its narrowly scripted dialogue
For a few years I had this dream about personal AI bot profile (in CS2, possibly?): you start a "Practice with bots" session, play with normal old bots and your demo is recorded, then on free time or even parallel to playing a special network is trained on your gameplay to better mimic your skill level. Each subsequent session, therefore, is out to get better and better. Of course first few generations will be terrible, so the difficult part would be to figure out how to balance scriptedness and AI control, but I'm convinced the soft is ready.
Imagine we get to a point where those infinitely branching storylines become reality. An infinite story generator, with AI generated everything; questlines, items, big events, npcs, secrets...etc. An ever-evolving fantasy world. Those mangas I read about VRRPGMMOS could 100% happen in my lifetime. The possibilities are endless.
For this to be so good so early is really impressive. Nowhere near stable enough for complex quests etc but imagine it after 5-10 years of development. This could be a total game-changer for RPGs and rogue-likes.
I'll never forget when Barney followed me up to the roof of the Citidal in HL2. He's scripted to open the stairway up the roof then stay on the floor level. But, when I joined the firefight on the roof I hear behind me, _"Open fire, Gordon!!"_ He spawned on the roof. After several tries and saves, (and screencaps of his dead body here and there) I managed to get him to the place where the Strider rises up out of a bomb crater, then he finally despawned. I stopped updating the game and played offline, kept carrying objects from map to map to build high towers to get up to places and must have caused a glitch that had Barney spawn where he wasn't supposed to be. Its like that secret island you discovered, I know the feeling.
What if this included AI voice cloning for the voices like elevenlabs' stuff You could get actors to put in voice samples and then play back using those same character voices
You know, they will have to put in reactions for text and not just voice for those who 1) do not have access to microphones, 2) cna not talk at the moment (say people in the room), or 3) can not speak at all. Like in Façade.
Our tech outputs both text and voice. Developers can choose to use text alone, voice along, both together, or give the player an option. In this demo we chose to use voice but all of the options are already possible!
What an awesome idea! I would definitely want to play a game with this kind of tech in it! Also this is what good sponsored content looks like, actually good product that are not predatory or useless!
THIS as a mod for Skyrim VR... :O I already use a pretty crude voice recognition mod for the dialogue in that game and even that is such a gamechanger. synthesizing ai voices from the existing voice lines shouldnt be difficult, however implementing it and configuring all the npc would probably be a huge effort. maybe someone crazy enough from the modding community is going to make it happen one day ;D
There was a game called Facade which did this in 2005, though there's much less dynamic-ness to that game since the lines were all written with real voice actors and works mostly off of keywords the player types. I really would love to play a version of that game with this improved tech. This is fascinating stuff
The "I hope future generations can learn from our mistakes" (paraphrased) line is one I have felt myself when things have gone wrong. It is quite deep.
Isn't this the exact thing you talked about trying to make in one of the Game Making Journey videos? A real shame you didn't figure this all out 15 years ago, I expected more from a man of your genius.
Our models have machine vision and, when implemented, could comment on what you're doing and wearing in a game. We did a test months ago with a Queen of Hearts character and had her mock the people in music videos. It was pretty funny.
I find AI incredibly facisnating but also very scary. I can see a day in the future where AI can make and run an entire game start from finish. If that happens who knows? Infinite games that can be made instantly and to your specification sounds like it would be dangerous.
Certainly the future we are heading towards. Personalized content rather than hand made content. Probably 25 or more years out before that even begins to reach the public, but nevertheless our trajectory.
@@eatham. I would say a constant entertainment consumer stupor would probably be one of the worst things to happen to human civilization. Far more concerning than this vague idea of AI world domination.
Imagine if you could make a library of your own voice, and then apply to a game with a voiced protagonist for him to deliver the lines with your own voice, or any of other voice you choose. I tought of Fallout 4 as example of having a voiced main character.
Kind of missing the point, if you can talk to it, and it can understand you, why bother with pre-written responses? lol. Unless you mean for a mod, cuz I agree, that would be a cool experience. Not sure I want to hear my own voice though, lol
This tech and the tools even already developed can answer so many long standing gaming limitations, it's going to be great. People are already starting to add new voicelines to games using the OG voice actors and AI. It's finally reasonable to have exceedingly niche highly specific dialogue since it's only the matter of writing that interaction.
dude if you allow interactions and action loops in goal oriented planning to somehow tie in to their verbal response system, you would have hostile soldiers in a game issuing callouts to each other dynamically as actual communication and the longer a group of soldier AI stay alive, the better their bond is, and more likely they are to absolutely shred a player for downing one. They could form tactics and roam the map doing their own missions in the game world instead of being a scripted encounter.
Huh. I saw these inworld guys like a couple years ago when looking for AI bots. Glad to see it still exists and is being reviewed by none other than the second kliksphilip.
This reminds me that games normally dont even use TTS. No mans sky could have aliens speak their language and ours mixed together based on which words we understand.
19:36 This should be possible. Have the AI summarize major steps in plot or discussion and save that for next time. It becomes World Info for that Character. Wild times!
the AI is balancing between hard-coded programming and also randomized permutations of answers in an adaptive, unpredictable environment wait thats DNA and human evolution too 😳
I feel like the missing pieces for the AI to sound more authentic is to have more human made data to build off of, like exemple of dialogue per different context and voice actors saying those line. For an important NPC it could be pretty extensive, but for a bystander it could be a random mix of character trait and background. I don't think we're at a that stage of compute power and software optimization yet.
This is exactly whats so exciting about the future generations of games, not rtx but proper ai implementations. Even something as simple as bannerlords chatgpt chat mod was hype.
I think we'll definitely be getting text to 3d environment technology soon along with ai made animations (I think this is already a thing at least partly) and ai made story lines so I wouldn't be surprised if a text to game engine would become a possibility in the future. That along with everything happening in vr. Imagine just turning on your PC, telling it what kinda game you're looking to play, waiting a bit and starting gaming where the world and lore get formed and fleched out as you play.
I came here for the information, but those absolutely golden questions made me laughs probably more than i should! my hair is falling as well hahahaha!
I honestly can't wait for this to reach it's true potential, maybe we'd be able to mod our older games and give them life again with AI, infinite quests and content!
That is really impressive for what it's worth; imagine animations being AI driven in the future as well. This is going to be so immersive, I just hope it has a seamless transition into modern gaming rather than being seen as a gimmicky tech demo like past games with voice recognition
5:50 in the future when you are unsure if the other person is an AI, just ask if they can describe the current situation as a poem
THIS!!!!
Bullet proof ;)
A friend and I were actually pretty skilled at doing just that in seventh to eighth grade or so. You could be talking to a kid with too much time at their hands and weird hobbies. :>
@@willguggn2 close enough.
pumps shotgun*
Or ask them to pirate a video game, they would rather die than pirate anything
Josh is actually the most realistic character on this tech demo, that's how 99.95% of factory workers feel about their job
It was so legit
So?
6:56
"Describe your personality in 26 words"
- Upset, frustrated, scared, negative.
"That was 4 words, Josh.."
- ....So?
You got owned there. He doesn't give a fuck. He's not boring, he just has completely given up on life.
Very realistic factory worker indeed, I'm impressed.
@@telefrag. sad
He just like me
I mean, people who give up on life ARE boring, though?
@@telefrag. ironic since they are replacing factory workers
Just imagine that someday an ingame NPC starts begging you to not turn off the game, so they can live.
They can already do that. You just need to include in their profile that they are scared of being turned off.
@Render Wire no need for that. They are already doing that
Thinking about this makes me sick.
*Shoots them*
Gotta make sure its off.
#JusticeForTay
I remember a couple of years ago the game AI Dungeon had a lot of trouble with keeping track of whatever happened prior. These NPC seem amazing at keeping a coherent conversation in comparison.
AI Dungeon was the precursor to all of the recent AI popularity; the harbinger of what's to come. It's a shame that the game is a shell of its former self-I used to have a blast messing around in it.
What happened? Haven't checked it out in a while.
@@explosionspin3422 same, but i followed the subreddit for a bit; apparently the creators placed a lot of limiters on the engine, and there were some monetization issues. though supposedly the more dedicated userbase isn't experiencing any problems doing the things they've always done, it's just that the creative freedom and "pick up and play" part of it has been "downsized" (?) a little bit
@@privatepengu They used to use ChatGPT based models, and those models got lobotomized by openAI so they switched to different models and AIdungeon is pretty good now.
@@meatisomalley how long ago was it they started using chatgpt based models? was that when they introduced dragon/griffin or before that
Wow, this is like... Roleplaying games may finally involve roleplay. I would totally, absolutely bumble through this with a cliche noir affectation like a 1930s detective and have a blast
Getting engrossed in your Dixon Hill stories again I see, captain.
almost feels like we are seeing a very early version of actual westworld lol.
In time with augmented reality, I can see a real life westworld existing
6:57
Nope, nope, nope. That is actually frighteningly human. Josh isn't boring, Josh is just fucking *done*, having worked in a factory for a while I can say Josh is our spirit animal. That is a depressingly realistic character.
16:16 "Endless unseen islands" feels all too relatable. I really miss the young days of playing games and letting my imagination run wild. I'm honestly stoked to see how this tech can and will shape games.
I wonder how speedrunners would adapt to these kind of technologies. Can you imagine a future where speed runners lead the forefront of AI research?
Like software engineers testing every edgecase, speedrunners abuse them.
top 10 questions guide
Imagine being an AI npc in a video game and a speedrunner walks up to you, blurts a string of random key phrases, and causes you to finish the game for them
@@TheFlyingslug "hello i am a speedrunner and i want this game to end as soon as possible, can you finish the game for me please?"
Speedrunners are gonna be the greatest social engineers with this tech
Damn, imagine like playing divinity and being able to convince the evil guy to just give up fighting or join your cause
Or in the middle of a gun fight, during a stalemate convincing the enemy to turn sides and help you, yet have the change of them pretending to help you to get closer and kill you. This incredibly human situation happens a lot on games like rust or among us so it would be awesome to see that awkward dance of whether to trust or not happen between an AI and a human.
Real life charisma roll nat 20
@@JT-ev8sd😱
20:12 imagine you witness a factory blowing up and the detective comes up to you and asks you for some python code
and you just recite it for him. word by word. including imports.
Looks promising, but I really hope that these AI models will run locally instead of in the cloud.
Would suck to see single player stories with an experation date
Yes. Luckly ther are alredy good open source models
We'll get it eventually. Don't look at where we are, look at where we'll be in a few years time.
There are plenty of pretty good open source models you can run locally. They're pretty easy to find on huggingface. Though, the ones that have decent intelligence and coherence are pretty heavy. You can run them on the CPU, but then they run at a glacial speed. Ideally you want to run them on the GPU, but then you need one with plenty of VRAM. You can get light models too, but in my experience, they are too dumb to be all that interesting.
I share this sentiment, friend! I don't want there to be another reason for games to be tied to an online server.
@@andyasbestos Hopefully we'll be getting dedicated AI hardware, even if the trends are to move everything to cloud. Another possible improvement I see is specialized AI models trained only using the set of data strictly necessary to perform its function. Like, a model trained to act out a specific NPC
16:50 This unlocked a memory.. I was watching someone play this game and every time they tried to get to this island something bad happened. I remember the fairies and them being super uncooperative and some puzzle doors, and the long garden..
Josh is the most believable of the bunch. Like, the one who did the poem for the asking of it, doesn't come across as anything like a real person, but more like chat gpt. Josh doesn't care about your questions, and is annoyed he's being inconvenienced. He has a terrible, demanding job, and doesn't have time for his own pursuits, and now a detective is asking him irrelevant questions, when he just needs to get to work to earn his living.
It would be hilarious if in future games, you can scare NPCS to leave the scene using a similar method you tried at 15:30. Like telling them the building they are in is on fire and watch them run out only to realize you lied to them... all without having to be scripted.
My best friend spent a few years of her life completely stuck in Skyrim, she was so shut out of the real world that she recognised the NPC's as real people, and even still to this day feels strong emotions if one of the NPC's she was "close" to is killed, even if it's not in her game, and that was with Skyrim level NPC's. I absolutely love this technology, and the possibilities for NPC's in the future if gaming took this path is endless, however I think it's really important to consider the real world problems this could potentially cause, not the "AI will turn evil trope", but the connections people could end up forming with characters that could potentially replace human contact, something that isn't healthy.
Imagine if Skyrim had this level of AI, but with a better speech model and more polished in general. I genuinely fear that some people may completely replace human contact and catch real feelings for NPC's within the game, something that isn't healthy on it's own. Now imagine someone who does this decides to marry a character, and over the time of their save gets to know all of their likes and dislikes, like how they love mountains but hate heights, or how they love red apples more than green ones, just stuff the AI randomly generated and saved into your game file for that character. Then one day that persons save file is corrupted, and they have to start over, that character will be different this time around, it will have the same backstory and lore that the writers have created, but nothing the AI generated, to that person if they are genuinely tricked into believing this is a replacement for real human contact, they have just lost their wife. It could literally drive people insane.
You might think this is unrealistic, but again I have seen this already happen in the world with gaming, and I fully believe if Skyrim or a game like it had perfected this tech, my friend would never have gotten help. I genuinely would love to see RPG games with REAL characters, but I think this is a topic that does need to be seriously considered before it can ever be carefully implemented into real games.
When the AI is a better companion than real humans.
There are already people who prefer to chat with an AI chatbot than real humans, I've learned about it thorough louis rossmanns channel where he recently talked about it.
Blade Runner 2049 GF incoming
Fear not, it already happened. There were some news recently about an ai chatbot service for romantic purposes that changed how the bots worked after a while and people were furious. Google "replika ai scandal" or something along those lines.
Honestly a lot of modern communication is not healthy. You need good conversation, good people. Without healthy people around you, you're better off with an AI anyway.
Currently AI isn't there yet, but I don't think this is a negative. It'll certainly be healthier than trying to hold a conversation online 90% of the time.
I feel so bad for Alex hahhaha, this is such an excellent video. One of the best executed sponsored videos, awesome work.
It's very impressive both how well the demo works and how you managed to showcase it in the most entertaining way
I have been waiting for this since I was 10. I'm overjoyed to see that someone is starting to integrate AI into game characters. : )
How old are you now?
@@ethancobb4002 11
@@sunnysideeggs lol
@@sunnysideeggs okay that was unexpected
That exciting feeling that there might be lots to explore in a game is one of the best feelings.
I got that feeling when I played INFRA, a Source-based story driven puzzle game. It has such an open and detailed world with several pathways through a linear story, with lots of secrets, that I felt like I could go anywhere. I could interact with everything in the world, and I truly seek that feeling again in a game.
this is unreal, i cant belive how far AI has come in such short time. imagine if they had a whole body script or model that lets them freely move however they want at their own will. they could get super deep with this like if their age sets restrictions on certain parts of their body for movement or even damage taken, i feel like even for the character you are playing it could affect your gameplay
The adventure game section really sent this video home. That curiosity is something I deeply miss with gaming. You’ve officially cranked my interest in AI and video games.
I recently started playing Shadows of Doubt. Imagine such a procedural investigation game combined with the tech in that demo.
now I can ask NPCs for some sweet, sweet, Starch Kola..
Don't happen to have any do you?
@@masterman397 Get one at your local dumpster you bum. But seriously that game with this kind of A.I would be a walking talking noir film generator
I thought about that too. That would be really fucking awesome, having different personalities and some people getting angry or scared of talking to you, having to lie to them just so you can get info out or threatening them. Seems like a thing that NEEDS to be added there.
They need to ditch all their fancy lighting and whatnot to make overhead for this stuff. Who cares if the pixelated world is slightly more reflective! Give me performative npcs!
@@KyriosHeptagrammaton I'm sure the game can be optimized enough without downgrading visuals, just need to give them time.
No more ingame war crimes boys 😥
it kinda still can happen lol, just allow an AI NPC in the code with war crimes and gets triggered with a specific event or if told to?
you can kinda still give an AI NPC a personality
I loved them calling you out for the tediously long name, and the only character to pronounce it in its entirety was a cripplingly grandiose megalomaniac 😅
Story driven games of the future gonna be wild.
"What do you mean take me 2k-"
"I SAID TAKE CARE, ALEX!"
It's funny how this is the second thing I've seen this week that I said would be cool 2 years ago only to be called an idiot for because I "didn't understand how AI worked".
With AI writing and voicing dialogue, helping animate models, drawing landscape textures and models, and helping create large numbers of variations for natural looking effects, it looks like game design is being streamlined at a pace that finally exceeds the increase in complexity.
What an interesting demo. Talking about Kings Quest, one day there might be an AI that can seamlessly add new locations to a game that no-one has ever seen before... keeping the mystery. By the way, love that updated music you've been using.
Philip is gay
I thought about the possibility of implementing this into TES6 but had my doubts since Bethesda is not known for pushing technical boundaries. But since Microsoft owns them now they could just make them do it like they did with Bing. It would be one hell of a marketing tool.
Bingo
@@2kliksphilip this video was running through my mind while watching this one
@@Dionyzos True, but they are probably way too far into production to be able to add it now. I'd imagine you have to design your game from the ground up with AI NPCs in mind, and you have to do a lot of testing beforehand to figure out the limits of what the technology can currently do.
@@pentapa3923 TES6 is still in pre-production seeing as their next game, Starfield, is still in full production mode, so it'd be possible to implement. Todd however has said previously on a podcast interview on the topic of AI voice generation that having the voice actors is very important and they add so much to it. The technology is growing rapidly thought and assuming they create DLC for Starfield which could take a year then full production for TES6 would start in about 17 months, by which point this technology could look much better, who knows.
YES AI controlled NPC dialogue is FINALY here! Ive been dreaming about this for years. This is the future of gaming. Fine tuning and more refinement will inevitably make AI controlled stories, reacting on what you do rather than scripted events. Like RPG's
Immersion and realism is the holy grail of gaming, and this is a massive step on a new road towards said holy grail. Imagine a game as expensive as Skyrim with all of the NPCs being genuinely meaningful. Having a dynamic relationship with your companions even. Wow
I feel like we've just gotten glimpse of what games in the future may be like. Imagine RPGs where YOU control your dialogue and characters respond in realistic ways. That would be gnarly
I just saw your ArmA Reforger video. You've seriously gotta check it out now! We've got 5 different helicopter mods! RHS mod, Javelin missile, tanks with tracks! Tons of gun mods!
Oh my god this is so freaking cool! It reminds me of those voice commands that swat 4 has and when I would debate chatgpt on deus ex and system shock and whatnot lol, I can already imagine so many cool concepts with this!
Imagine if they put this in Unrecord, both for investigation and for suspects and civilians on active scenes
as if the game didnt look real enough already!
@@hi_its_jerry This is gonna have the opposite effect. The current TTS solutions haven't even approached the uncanny valley, let alone surpassed it, and are uncapable of expressing emotions (as far as I can tell), meanwhile Unrecord has a lot of angry shouting
@@trainee5471 That is fair, but I was imagining it'd use AI speech synthesis instead of TTS. Same problem applies to both tho
@@trainee5471 elevenlabs is pretty good.. but not fast enough if that’s what you mean
@@RustyShackleford556 Well, I equated AI speech synthesis to TTS in my comment, because it is defeacto nothing more than TTS at this point
I think bioware style games will always work best with hand crafter characters with well written personalities. For random npcs though, or more open rpgs like bethesda is known for, this tech would be incredible once it matures.
We agree that great writing is key for certain games. Our tech allows for scripted lines to be used with event triggers or in line with player intents so that you can have characters say key dialogue that pushes the game narrative forward -- and also be able to ask them anything while having them respond in character. Plus, we can make the scripted dialogue non-repeatable and you can have the character wait until the right point in the conversation to say the scripted dialogue. So, you get NPCs that don't repeat themselves or randomly blurt things out.
@@inworldai ok, that's actually pretty cool. There's always a certain level of sadness when you finish a game like mass effect and know that you've heard all that anyone will ever say. This would effectively solve that.
I assume the scripted elements would also be able to have actual voice acting too? That's another thing that AI might be able to do convincingly, but not with the same depth or meaning
@@existentialselkath1264 It would still use voice models but game studios can use their own voice actors to train their models. Our tech has an emotions engine that changes voices based on the emotion an NPC is feeling at any time and there are other pretty advanced voice AI models that you can engineer to use with our product like Eleven Labs.
Also, just imagine this technology being incorporated into a BioWare like game with companions with whom you could have proper conversations.
I think of wandering through the woods in an Elder Scrolls game and being able to ask questions like "which way is it to town?", "what time is it?", "do you have anything to eat?".
I can envisage a future where voice actors are hired to train AI voices rather than perform the lines, but that's probably quite a lot of tech to have running in real time.
Josh seems pretty relatable ngl
Regardless of any downfalls with AI chatbots, when it comes to the immersion of seeing something actually react to you, this still seems like an objective improvement over a typical NPC that doesnt have any perception beyond its narrowly scripted dialogue
For a few years I had this dream about personal AI bot profile (in CS2, possibly?): you start a "Practice with bots" session, play with normal old bots and your demo is recorded, then on free time or even parallel to playing a special network is trained on your gameplay to better mimic your skill level. Each subsequent session, therefore, is out to get better and better. Of course first few generations will be terrible, so the difficult part would be to figure out how to balance scriptedness and AI control, but I'm convinced the soft is ready.
Oh, and throw at them the ability to talk to each other and player in real time, like in this video, and you revolutionize competitive fps
"he may have died in the explosion"
"do you like cats" 😂
i enjoyed the video
Imagine we get to a point where those infinitely branching storylines become reality. An infinite story generator, with AI generated everything; questlines, items, big events, npcs, secrets...etc. An ever-evolving fantasy world. Those mangas I read about VRRPGMMOS could 100% happen in my lifetime. The possibilities are endless.
For this to be so good so early is really impressive. Nowhere near stable enough for complex quests etc but imagine it after 5-10 years of development. This could be a total game-changer for RPGs and rogue-likes.
DAMN YOU. This is now my favorite video I put it next to your old Operation Flashpoint video.
Wow, I was literally just playing Cyberpunk and thought AI would be really useful coming up with random NPC chatter and dialog.
I'll never forget when Barney followed me up to the roof of the Citidal in HL2. He's scripted to open the stairway up the roof then stay on the floor level. But, when I joined the firefight on the roof I hear behind me, _"Open fire, Gordon!!"_
He spawned on the roof. After several tries and saves, (and screencaps of his dead body here and there) I managed to get him to the place where the Strider rises up out of a bomb crater, then he finally despawned.
I stopped updating the game and played offline, kept carrying objects from map to map to build high towers to get up to places and must have caused a glitch that had Barney spawn where he wasn't supposed to be.
Its like that secret island you discovered, I know the feeling.
What if this included AI voice cloning for the voices like elevenlabs' stuff
You could get actors to put in voice samples and then play back using those same character voices
Thats why they can be replaced and the whole industry shaking
And a database of personalities to tag NPC's with so they can have thousands of different people, just tweak them for different games
@@635574 Ðis isn't a matter of replacments. Humans physically can't voice over endless lines.
13:10 - he is *literally* singing the Scatman song
You know, they will have to put in reactions for text and not just voice for those who 1) do not have access to microphones, 2) cna not talk at the moment (say people in the room), or 3) can not speak at all. Like in Façade.
...or Kings Quest.
Our tech outputs both text and voice. Developers can choose to use text alone, voice along, both together, or give the player an option. In this demo we chose to use voice but all of the options are already possible!
In this video, the super advanced AI, known as 2kliksphilip, interacts with lesser AI and reports his findings.
A fascinating gameplay feature that I really hope never gets widespread adoption
I’m excited about this tech for the future of games. Things can become so much more open-ended and immersive.
fuckign amazing video phillip... were watching the future together and u give me so much context, concepts and ideas to it
What an awesome idea! I would definitely want to play a game with this kind of tech in it! Also this is what good sponsored content looks like, actually good product that are not predatory or useless!
I am so glad you used ever more of dad's music in this video!!!
Oh my god! This has been a feature I've wanted to add to a game of my own in the future. I'm stoked to see the future of this tech, my god.
THIS as a mod for Skyrim VR... :O
I already use a pretty crude voice recognition mod for the dialogue in that game and even that is such a gamechanger. synthesizing ai voices from the existing voice lines shouldnt be difficult, however implementing it and configuring all the npc would probably be a huge effort. maybe someone crazy enough from the modding community is going to make it happen one day ;D
seems like there's someone crazy enough ruclips.net/video/Gz6mAX41fs0/видео.html
its already happening. ruclips.net/video/Gz6mAX41fs0/видео.html&ab_channel=ArtfromtheMachine
pray the creation engine for skyrim supports it
Look it up, it exists
@@callader-6815 incredible, yes a verion of this is being developed at the moment using gpt-3.5.
There was a game called Facade which did this in 2005, though there's much less dynamic-ness to that game since the lines were all written with real voice actors and works mostly off of keywords the player types. I really would love to play a version of that game with this improved tech. This is fascinating stuff
The idea that humans could work as NPCs in online MMORPGs in the future has totally throwed out the windows with this
This is revolutionary. I never imagined the day I would in action. The advancements in AI have opened so many doors previously locked.
missed famous heisenberg name dialog opportunity
Imagine this combined with the nemesis system. This is cool.
Josh is the most relatable videogame NPC
I have to try this demo. Can't wait for more npcs like this in future games.
The "I hope future generations can learn from our mistakes" (paraphrased) line is one I have felt myself when things have gone wrong. It is quite deep.
Isn't this the exact thing you talked about trying to make in one of the Game Making Journey videos? A real shame you didn't figure this all out 15 years ago, I expected more from a man of your genius.
Since GPT 4 can pick up knowedgle from a visible image, just by uploading the avatar, the LLM could know if they'd be bald.
Our models have machine vision and, when implemented, could comment on what you're doing and wearing in a game. We did a test months ago with a Queen of Hearts character and had her mock the people in music videos. It was pretty funny.
man the moment chat GPT came out I was just waiting for this
I've been waiting for games like this all my life. Oh lord. (sing it ala' In the Air Tonight).
Thanks for uploading this.
Absolutely fascinating.
I find AI incredibly facisnating but also very scary. I can see a day in the future where AI can make and run an entire game start from finish. If that happens who knows? Infinite games that can be made instantly and to your specification sounds like it would be dangerous.
Certainly the future we are heading towards. Personalized content rather than hand made content. Probably 25 or more years out before that even begins to reach the public, but nevertheless our trajectory.
@@AnonsTreasures Let's just hope it doesn't cause us to end the world or something over it. Enter like a constant entertainment consumer stupor.
@@eatham. We're getting to WALL-E faster than anyone expected.
@@eatham. I would say a constant entertainment consumer stupor would probably be one of the worst things to happen to human civilization. Far more concerning than this vague idea of AI world domination.
What
Imagine if you could make a library of your own voice, and then apply to a game with a voiced protagonist for him to deliver the lines with your own voice, or any of other voice you choose. I tought of Fallout 4 as example of having a voiced main character.
Kind of missing the point, if you can talk to it, and it can understand you, why bother with pre-written responses? lol.
Unless you mean for a mod, cuz I agree, that would be a cool experience. Not sure I want to hear my own voice though, lol
This tech and the tools even already developed can answer so many long standing gaming limitations, it's going to be great. People are already starting to add new voicelines to games using the OG voice actors and AI. It's finally reasonable to have exceedingly niche highly specific dialogue since it's only the matter of writing that interaction.
Everyone else: Are you single?
Philip: Do you like cats?
dude if you allow interactions and action loops in goal oriented planning to somehow tie in to their verbal response system, you would have hostile soldiers in a game issuing callouts to each other dynamically as actual communication
and the longer a group of soldier AI stay alive, the better their bond is, and more likely they are to absolutely shred a player for downing one.
They could form tactics and roam the map doing their own missions in the game world instead of being a scripted encounter.
that would be sick, a freeform ai system. all with their own goals and methods
@@tuxedo1557 BRO YOU COULD DEADASS USE THAT TECHNOLOGY TO DO IMPROV ACTOR SCENARIOS IN A DATA WAREHOUSE and QUERY IT FOR MOVIES ON A PROMPT BASIS.
Imagine shadow of war with this technology
Huh. I saw these inworld guys like a couple years ago when looking for AI bots. Glad to see it still exists and is being reviewed by none other than the second kliksphilip.
This reminds me that games normally dont even use TTS. No mans sky could have aliens speak their language and ours mixed together based on which words we understand.
19:36 This should be possible. Have the AI summarize major steps in plot or discussion and save that for next time. It becomes World Info for that Character. Wild times!
Already better than Bethesda NPCs
Let me guess, someone stole your sweetroll?
Hello!
Oh it's you, hi.
Goodbye!
@@lilwonka Have you heard of the high elves?
@@Magusslettewestberg high on what?
the actions model with live voice responses is just a convincing irl robotic body away from being a bladerunner replicant
Replicants aren't AI, they are synthetic human engineered biological beings
the AI is balancing between hard-coded programming and also randomized permutations of answers in an adaptive, unpredictable environment
wait thats DNA and human evolution too 😳
I feel like the missing pieces for the AI to sound more authentic is to have more human made data to build off of, like exemple of dialogue per different context and voice actors saying those line. For an important NPC it could be pretty extensive, but for a bystander it could be a random mix of character trait and background. I don't think we're at a that stage of compute power and software optimization yet.
This is exactly whats so exciting about the future generations of games, not rtx but proper ai implementations. Even something as simple as bannerlords chatgpt chat mod was hype.
These AI responses mixed with Euphoria (generated animations used by e.g. GTA 4/5) could be really cool
Josh is the most british NPC to have ever existed.
I struggle to imagine what games will be like in the next decade... things are starting to get really weird really fast with advancements in AI
I think we'll definitely be getting text to 3d environment technology soon along with ai made animations (I think this is already a thing at least partly) and ai made story lines so I wouldn't be surprised if a text to game engine would become a possibility in the future. That along with everything happening in vr. Imagine just turning on your PC, telling it what kinda game you're looking to play, waiting a bit and starting gaming where the world and lore get formed and fleched out as you play.
@@JT-ev8sd For sure and highly probable that will be reality too. Exciting stuff
"My father might have died under the debris of the explosion!"
2kliksphilip: "Do you like cats?"
This is genuinely really incredible, but also a little scary haha
I came here for the information, but those absolutely golden questions made me laughs probably more than i should! my hair is falling as well hahahaha!
I honestly can't wait for this to reach it's true potential, maybe we'd be able to mod our older games and give them life again with AI, infinite quests and content!
This is the key we were waiting for. You know what I mean. The ball needs to get rolling for a Façade remaster with this.
Alex is my favorite he had me laughing till tears started coming out.
That is really impressive for what it's worth; imagine animations being AI driven in the future as well. This is going to be so immersive, I just hope it has a seamless transition into modern gaming rather than being seen as a gimmicky tech demo like past games with voice recognition
ask them "how dose you know my name?"
Sad Lady: "I fear that my father, Dr Lafton, was trapped in the lab after the explosion and therefore dead."
2kliksphilip: "Do you like cats"
"hey alex, what's your name?" Is funnier than it should be.
The rhyming poem was pretty impressive lol
Can you remake Façade using this tech?