Can Chat GPT replace the NPC in my Game ?
HTML-код
- Опубликовано: 24 июн 2023
- What if Chat GPT could control a NPC ?
❤️ Support on Patreon : / valemvr
🔔 Subscribe : www.youtube.com/@ValemVR?sub_...
👍 Valem Tutorials : www.youtube.com/@ValemTutoria...
🌍 Discord : / discord
🐦Twitter : valemvr?lang=en
🔥 Tiktok : / valemxr
····················································································
📝Best VR Assets ( These links are Affiliate links which means it costs the same to you and I get a small commission. Thanks for your support!)
VR Interaction Framework
assetstore.unity.com/packages...
Hexabody (Physics VR Player)
assetstore.unity.com/packages...
Mirror and Reflection for VR
assetstore.unity.com/packages...
Auto Hand (automatic hand grab pose)
assetstore.unity.com/packages...
Hurricane VR (vr physics interaction)
assetstore.unity.com/packages...
3d Hand Model for VR
assetstore.unity.com/packages...
····················································································
📝Full Series on How to make a VR game • How to Make a VR Game ...
····················································································
If you enjoyed this video, here are some other really good channel you should appreciate :
⌨️ Game Dev
Brackeys : / @brackeys
Dani : / @danidev
Code Monkey : / @codemonkeyunity
👨🎓 Vr Dev
Justin P Barnett : / @justinpbarnett
Vr with Andrew : / @vrwithandrew
····················································································
#vr #vrdev #madewithunity 
Игры
The fact that you can make him do things on trigger, I’m just imagining the potential of a Sims type game in VR
It's mindblowing when it actually do more than talking, the only downside is that it's very unpredictable because its based on the AI will so I don't know how they can handle that versatility in gameplay. :o
@@ValemVR trueee
@@ValemVRmake a separate modal with unity ml agents to control the needs based state machine and use something like deepminds Gato to link them together.
You can also use open source stuff like RIVET and Supabase for the logic outside the game or experience. That's where you can execute advanced stuff like setting up agents and complex prompts and logic for autonomous sims.
In fact there's already a game where the NPC's live independent lives all on their own within the game.
@@NoCodeFilmmaker whats the name of the game?
This is some genuinely cool stuff! I imagine that there are some awesome ways people can incorporate this in their games and I can't wait to see what the future holds.
So cool and I love how you always incorporate humor
I love this. One of your best ideas yet! Here's a silly suggestion.. you could make it so there's these really hard puzzles to solve and you need to talk to the AI to help you solve them.
Nice content as always. You always manage to put a smile in my face. :D Thanks!
Awesome buddy... That's really cool. I just loved it. You have really worked so hard for this. Hats off sir...
I love this project I beg you to keep working on it!!! it is so awesome, I would love to see the bar lady to be able to serve you drinks, or to have characters walk around the bar and talk to each other, maybe they could even know your location and the time, like asking you to come closer to them so they can hear you better, or exit the bar to go home and that type of thing.
I have done something similar, also using the same openai unity module. The way to get faster answer is: stream gpt-3.5 response and "simulate" streaming whisper API, by recording chunks of 5 seconds. Its a little tricky but you can get responses in 2-3 seconds
Well done, Valem!!
Another stellar video! Your skills are awesome but your personality makes this videos worth waiting. Great job and thanks for a couple hard laughts. With ChatGPT, my thoughts are automatically goes to another level. Not only NPCs guided by AI but entire game (engine) controll by AI. You can come back to a game you love and have new experiences every time you come back to it! (Main line of events remine constant but side quest can have infinite possibility and make game experience even more awesome)!
thats so dope ai is gonna be crazy in the future. great video, so funny too.
This is really cool stuff. Someone did something similar with ModBox a few years ago, been waiting on a follow up ever since gpt4 dropped lol
interesting stuff man, keep it up
This was great!
Great Video i will look forward too the patreon tutorial!
Thanks will try to post it as soon as possible :)
Big shoutout to the amazing folks doing the VR Jam 2023 currently ! itch.io/jam/vr-jam-2023
Great work.
Really cool!
My god, that's so fucking cool
Great content, très bon turorial.
Love this channel
You should update this project using the new whisper api, tts api, function calling and the new model GPT-4-Turbo. Just build a class system for function calling, I would love to see an updated version.
This was actually really cool
Thanks dude :D
Je viens de découvrir ta chaine. Continue comme ça
brooooo that was epic
3:27 That was hilarious xD
...and I am here, still strugling to grab a cube
I really want to utilise this
When do you think the tutorial will be available
Like Allways i say Excelent video to wake up a new interesting toping!!!
I see you used lip sync for this project, how should I go about using lip sync for my multiplayer game where I'm creating cartoon characters from scratch? I'm thinking about using the Oculus Lipsync and having a Fiverr artist model the 12 blendshapes.
This is great!!! A great future. Many opportunities
Is there any real time voice cloning that i could use in production? I need SDK that i could use in unity game. I mean, something like I speech and it converts to any voice like bruce lee or will smith. I do not mean text to speach conversion. I mean, real time conversion.
West world! Let’s go!
I think it's awesome 😎 so much potential 🤠
Thanks for watching :D
Hey, Valem. Did you use any of the Generative Agents Architecture?
This is insane 😂
What software did you use to design Fred?
Hi man I used Character Creator. :)
Can someone help me i am trying to import the Kevin model in unity but whenever i import the model i get a fbx import warning stating that cant generate noramls for blendshapes
Why don't you use Oculus voice sdk ?...please let me know
3:49 favorite moment lol
Brilliant 😂😂👍
Hey there! This is exactly what I was looking to setup and test soon but now I won't need to! If youd like someone to test out the VR AI I'm your guy, I have some ideas we could do for a video as well as my community would love it!
what are you using for lip sync? I want to buy your Patreon subscription but I am not sure will it solve my problem. i have to lip sync and built it to Webgl platform I am tried multiple option but didn't worked for me
"good idea"
I wonder if you could do this with the open source chat models so it can run locally and have a playable demo, vs having to provide a chatgpt key and it costing money
I guess you could try to generate some response by using the Chat GPT AI and then save all of them locally and try to trigger one of the saved response to fake that the AI response in real time
@@ValemVR There are chat networks that can be ran locally that are not chatgpt like stable vicuna.
It's not as fast or huge as chatgpt though and It would probably be difficult to get it to work with unity.
@@nicks4727 Problem is for any of the half decent models you need a very beefy GPU, so you can't ship a game like that. You would have to run instances that the game would then poll over the network if you want it to work for people. For instance I've got a decently powerful machine with a 2070 Super, and even I struggle with anything larger than a 7B model. Then adding the task of rendering a game on top would make it completely impossible.
@@JeppeBeier Your right, I was thinking it would make a good demo for the people that had the hardware
@@nicks4727Then why did you even ask the question in the first place? The answer is yes, it just isn't feasible to make a game based on such tech yet, that is if you are looking to reach an actual customer base that could run it, but you seem to recognize that already.
You will get your Project Milo "game" soon enough, don't you worry.
This is something we did in our lab a few months ago using chatGPT
ruclips.net/video/gh4LszoIQ94/видео.html
just watch the complete video its crazy i love the way you used it on a historical person and the presentation setup with the quest pro passthrough great stuff!
@@ValemVR Thanks! I used some of your help with this channel! 😁
I want to see the tutorial, is the patreon off?
4:32 am I going crazy or was the haki sound effect 💀💀💀
Yeah! I'm glad that someone noticed it !
hopefully AI systems will expand the scope of what one developer can do
intelligent ford????
How westworld started :
True 🗿 moment
🗿
*snifffs* ahhhh...french memes - u -
Aha I had to drop some :D
I kept watching because of the accent
7:38
Are you going to continue the vr series
You mean the tutorials? Yes I'm posting one every week on my second youtube channel Valem Tutorials :D
@@ValemVR I meant the VR Multiplayer Series :)
Ineteresting if it would be hard to create for existing VR game..
push it to Oculus store right now
What is your software to create avatar and visieme ? Green and Black for its interface... I think it is maybe a tool from Nvidia ?
I created 1 french VR multi experience using metavoice, chatgpt, Google text to speech and Ovr lips. I have found 2 avatars from ready player with visieme...
Then I make your turorial with Rebecca ! That was my second avatar with visieme...
I dont know use 3D software like Blender or an others... And your software it can maybe easier for just create visieme from avatar generated by ReadyPlayerMe...
Then this Avatar, Fred was created by 3D artist or avatar generator like Meta humans but compatible with Unity ? Maybe a Nvidia tool, Again ?
I believe your are in beta test for their news tools ?
I see the response in another coment. Valem use Character Creator for create Avatar and visieme.
Hey! That's right, I use Character Creator 4. Just take care of choosing the right viseme type in CC4 that will fit to the blendshape target you'll need with your OVR Lipsync
install the game is available ? (allez quoi)
As alwaysss : perfect and funnyyyy
P.S.: would you please feed me too Valem ?
this is how westworld started... XD
Game?
and I'll challenge u AI CHAT DEEPAI u create a ncp/NPC
Wow this is just like the movie Free Guy (The concept)
ML is not AI!
ML = cheese
AI = a whole pizza
Nobody knows how to make crust, or sauce, or toppings, or a pizza oven. We just have provolone. It's not even mozzarella
This is all great but unfortunately now you cannot make a game like that and give it to players because they have to have their own API and paying subscription to what ever server you using or you would have to pay some enterprise version of subscription to have all them players playing your game at the same time, which is shame but we are getting there it is matter of time and anyone will have AI generated answer locally from their PC offline i think..