This was so incredibly interesting and has my imagination going wild! Unfortunately I'm pretty new to Unity/coding/gameDev so actual implementation, though I can have some ideas on how to work it out, likely would take ages for me to accomplish with the current 'trial and error' methods I have at my disposal. Still, so cool! Imagine not only using the AI for chat, but also for image generation, so the potion is unique in its appearance when they give it to you... crazy stuff!
So this seems to mean, sending the entire conversation history (prompt) on every question transaction. Surely this will get more expensive in tokens API costs, as the game progresses through scenes
Well, only the conversation with a single npc. But I agree that the longer the conversation with a single npc, the higher the cost for each conversation to and fro. A couple of ways of handling this: 1. Truncate older sentences in the conversation, 2. Reset the conversation each time you unselect the npc. If you do either of these, you will lose the flow of the old conversation as a result of course.
Hi. Im trying to implement this, but do not seem to have have enough knowhow in Unity... I have managed text to text through regular openai but fail miserably at the voice implementation. Is there an option you can share the project ? 🙏🙏🤞🤞
@@rlhugh yes... the implementation of it ... in unity and/or scripts.... currently I have a canvas that is connected to chatgpt via the openai chatgpt plugin for unity. This works ( though I'm still fiddling about with reverting in a good way)..
@@rlhugh I also noticed that you made your own test menus between different implementations of tts and stt... I'd love to try and see which works best... I'm also playing with using EEG to generate text... not only voice.
![Eminem - Fuel (Shady Edition) feat. Westside Boogie & GRIP [Official Audio]](http://i.ytimg.com/vi/k1OquBida9s/mqdefault.jpg)
This was so incredibly interesting and has my imagination going wild! Unfortunately I'm pretty new to Unity/coding/gameDev so actual implementation, though I can have some ideas on how to work it out, likely would take ages for me to accomplish with the current 'trial and error' methods I have at my disposal. Still, so cool! Imagine not only using the AI for chat, but also for image generation, so the potion is unique in its appearance when they give it to you... crazy stuff!
Thank you! And, interesting idea 🙂
So this seems to mean, sending the entire conversation history (prompt) on every question transaction. Surely this will get more expensive in tokens API costs, as the game progresses through scenes
Well, only the conversation with a single npc. But I agree that the longer the conversation with a single npc, the higher the cost for each conversation to and fro. A couple of ways of handling this: 1. Truncate older sentences in the conversation, 2. Reset the conversation each time you unselect the npc. If you do either of these, you will lose the flow of the old conversation as a result of course.
imagine gpt agent with vision in a open world game, i wonder if its possible
Hi. Im trying to implement this, but do not seem to have have enough knowhow in Unity... I have managed text to text through regular openai but fail miserably at the voice implementation. Is there an option you can share the project ? 🙏🙏🤞🤞
Just to confirm, you're looking at code for speech to text, and text to speech, is that right?
@@rlhugh yes... the implementation of it ... in unity and/or scripts.... currently I have a canvas that is connected to chatgpt via the openai chatgpt plugin for unity. This works ( though I'm still fiddling about with reverting in a good way)..
@@rlhugh I also noticed that you made your own test menus between different implementations of tts and stt... I'd love to try and see which works best... I'm also playing with using EEG to generate text... not only voice.
Since someone liked my reply, I'll take that for a 'yes' :) How is this? github.com/hughperkins/chat-ai-npcs-video-resources
(oh I missed your written replies somehow. Reading now)