THIS IS INCREDIBLE. EXACTLY what Star Citizen is missing with immersion and ease of access at times. But this would completely change the game for me. CIG has to see this immediately!!! 🤩
When Chris saw Hybrid Audio's realistic immersion sound video he had the sound team add a realistic sound module to the game exactly how it was designed in Hybrid Audio's video. So if this gets enough traction and Chris sees it, it's pretty much 100% guaranteed it will end up in the game.
@@CheapoAssit will not delay server meshing team or pyro team etc. This tech needs to happen. Even though voice attack exist on steam for a cheap price
Chat gpt is actually pretty expensive for business use, especially chat-gpt 4. If CIG can make it work great, but I hope they do the due diligence on cost first
I think this could be interesting for a Star Trek kind of experience as the captain, ordering crew mates to do certain tasks while maintaining your own, etc.
I was going to say, a large as fuck capital ship listed as only having a single required crew member. It's entirely run through voice commands and such, but has the downside of being significantly slower to respond to certain actions, while also being able to avoid obstacles and seeing the context of what's in view of the ship and such while you can just run around the bridge, faffing about.
@@NatjoOfficialThe problem lies in the actual complex tasks that need to be done.. like maintenance.. as none of these things are just.. artificial.. but ohysical tasks that need to be done. You would really need a lot of NPCs actually running arround checking etc. A bolted on AI could never manage.. or would be waaaay to expencive.. This would be needed to be done in engine with task specific software... and still be REAL heavy on the servers!
@@robertpatrick5861 not necessarily. You don’t need multiple GPTs running around doing stuff, you just need a single GPT controlling and sending out pretty rudimentary NPCs to do the tasks that need to be done, or for certain things simply a counter with “NPCs” available for a task and then a countdown to when that NPC is available again. It doesn’t need to be insanely complicated. Plus, you’d only need really the input interpretation of the GPT which is one of the lighter weight parts of it and something we’ve put in games before. Give the AI some basic pre-made voice lines, or even a text to speech bot which can generate from pre-made sentences cobbled together like “[fire detected in] [cargo hold]”. (Tbh, I don’t think it even requires a GPT at that point…)
@@jesfr3236 if we are just talking about the ATC Contatcs: its not AI inside SC its a AI here in real life just controlling the NPC so its no AI in SC Lore its just Game Tech For the Ship Controle yes this is against Lore
It cannot be overstated how much this will change gaming in the next decade. AI crew, companions, settlers, enemies. Your companions will remember everything you have been through together in game, will have unique personalities tailored to you, and actual conversational abilities. Prerecorded dialogue and interaction trees will no longer be needed. Missions will have nearly endless nuance, making them all unique to the player while progressing a wider storyline. NPCs will all be running basic neural nets giving them unique environmental and situational awareness/reactions. Graphics will become even more lifelike using generative AI to polish the GPU-generated graphics. There will be endless AI-generated side quests, the list goes on and on.
It will need to be worked on a great deal with some railroading for important story beats, if you've ever sat and tried to RP with AI it often forgets, misunderstands and outright curbs the conversation with unrelated topics. It'd be nice in small doses, but running major game systems with this would be asking for failure.
@@Sm0lPerson What you are playing with are very rough prototypes with garbage user interface. They're already are multimodal LLAMA agent swarms, I read about four different memory optimizations just this morning in white papers. Just this morning a single small file made SDXL 10x faster. Even a 3060 can spit out an image every couple of seconds. Instead of having a guess what sampler works best with what model you can just try all the samplers in less time that it takes to make a cup of coffee. It doesn't just make the images generate faster it makes the entire process 10x better for the same compute. Same thing for LLMs. LLMs still don't have it's "ComfyUI" yet. There is still a lot of very low hanging fruit, and lots of interested developers.
@@Sm0lPerson Yeah of course. I don't think anyone is saying this is ready for production it is more of a glimpse into the future of gaming and NPC interaction. It will likely be an add-on/modded feature to begin with, most likely accompanied by a monthly fee, soon followed by AI-generated DLC or mods then finally integrated into a game at launch. This is likely the worst it will ever be which, as a gaming enthusiast, is incredibly exciting.
@@Sm0lPerson like already mentioned your referring to outdated, obsolete and likewise poorly setup ai platforms, you also have allot of people even charging subs and other fees as well for junk ai, because they know your average consumer is clueless, even to the fact its possible to run them on a home PC, which means most AI platforms especially on any app store have a mandatory online service model, not only to milk your wallet to unlock their features etc, but also to collect and sell your data, which they cant milk if its released as a standalone download, so they not only prey of consumer ignorance, they also feed it through mis-information as well.
LIVE: UPDATE: We are thrilled to announce, that we are one step away from releasing our first version of WingmanAI! Currently we are in polishing phase and are planning to get feedback from our Patreons (as early access testers) earlier next week. If there are no major issues, we plan to release the first version to the public next Friday. To give you some insights on what to expect, here is a list of features that will be included in the first release: - Talk to different AI characters - Create / Modify your own AI characters - Support of multiple AI characters (each has its own configuration and history) - Define commands and keybindings which can be triggered by the AI characters - Define instant action commands which can be defined by phrases and are triggered faster (like VoiceAttack) - Enable / Disable audio effects - Plugin system to extend the functionality of WingmanAI and implement your own logic (including API calls etc.) - Multiple languages, even on-the-fly switching in conversations We are really looking forward to your feedback and your ideas on how to improve WingmanAI. Again, thank you so much for your amazing support! It really means a lot to us Have a wonderful weekend! --Original Post: Hello everyone. We are absolutely overwhelmed by the response and your feedback. We try to read every single feedback and update this pinned comment to a little Q&A ;-) 1. "How did you do it?" We're currently working on a series of follow-up videos to show you exactly how we did it and how you can do it too. 2. "It's like Voice Attack!" It's similar to Voice Attack, sure. The main difference is: you're actually talking to GPT-4 Turbo, which means: you don't have to say a specific keyword or command. You can, of course, talk to an AI and talk about anything in your mind. 3. "The response time is not fast enough." Yes, this could be improved in the future. But we already have prototypes that shorten the response time. And we will definitely talk about this in one of our next videos. 4. "This is not the Seraphim Station!" No, it's absolutely not ;-) To be honest: At the time of recording, I didn't know the name of this pyro station yet, so I just called it Seraphim Station. But that doesn't really matter, because the AI doesn't know anything about it either. 5: "How can the AI react to the scan results?" It can't at the moment because Star Citizen doesn't have an API or anything like that. GPT just made up a response, that's all. And yes, that is a bit arbitrary and not correct. Thanks again for your feedback and let's see in the next video ;-)
So for number five scan results why not have the ai respond with something like please refer to your dispaly or hud for results? or I have marked them on your display.
@@LevelGroundGamer you can simply train the AI to do just that. Like say a phrase to it "from now on anytime you do a scan tell me to check the hud". It's very teachable. Only issue is it does "hallucinate" quite easily so you would have to refresh what you taught it from time to time. I have a script I run every time I run out of tokens (although now it has significantly more tokens to use).
The beauty of this, is there's no one way to talk to the AI, the complexity of how you use it, can dynamically scale, to how you talk to it. If you want full ATC mode, it can do it, but if you want to simply turn on the engines, it can do that too, and unlike a typical game mechanic, you're not required to do either.
@@ShipBit only missing the API access for better feedback and control. Hopefully in the future, we see more of this type of NPC interaction in games, as well as the NPC conversations.
Well I never really started until this year, now this is the only thing I play. Assuming this is the pilot I called Khruu/4th, you got the right guy. @@chrisdavis7533
The big difference between this and VA is that there isnt a need to train the onboard hardware to map your voice, the AI just runs it itself and has a very good confidence level on these commands. Also non-scripted responses... just insane. Switching to other languages on the fly is just showing off.
NO This thing has huge potential. given the spending attitude of RSI customers and the potential of this work, I hope you think about creating a specific app. It has a lot of potential and real utility. An AI that can connect from the ship, to the helmet when you are outside the ship, is very useful. excellent earning potential. and choose which is the best depending on the parameters you enter. the voiceattack is just a repetition of instructions, here the APIs provide data and information to a system that can MANAGE AND MANIPULATE them. it's absolutely not the same thing.
Well this is just an excellent example of the power of the new openAI custom GPTs and the native JSON outputs with no latency and mutliple function calling at once can be now be utlised, im assuming this is using the openAI whisper API as well with the new GPT 4 model. Pretty damn cool if you ask me. Iv been watching all the use cases pop up over the last few days but this one i did not expect, nice work.
The delay will get better. The new 4 turbo model that he’s likely using has yet to be optimized for speed ( been optimized for sophistication and lower cost first). Also he’s recording his speech and then sending the GPT an audio file to analyze first. Great pattern for a compelling technology proof and when he or someone else takes it to the next step they will likely stream the audio into a separate speech-to-text agent and then pass the text to the GPT. That will reduce the time delay significantly. The thing to call out here is that he built, in under a week (the tools he’s using were released from OpenAI on Monday), a break-through compelling immersive experience, the likes of which have never existed in the gaming world. Fucking Bravo Zulu!
@@richardcharlesworth2020 According to ChatGPT 4 itself: Whisper, an automatic speech recognition system, works by converting your speech to text before it's analyzed by systems like ChatGPT. Here's how the process typically works: 1. **Speech Recording**: Your speech is recorded via a microphone or other recording device. 2. **Speech Recognition**: The recorded audio is processed by Whisper, which uses advanced algorithms to transcribe the speech into text. This conversion happens locally on your device or on a server, depending on the specific implementation. 3. **Text Analysis**: Once your speech is converted to text, this text is then sent to ChatGPT or similar systems for analysis and response generation. This process ensures that the language model (like ChatGPT) only deals with text input, maintaining a consistent mode of operation regardless of whether the original input was typed or spoken. The key advantage here is in maintaining user privacy and data security, as only the transcribed text, not the actual audio file, is sent for analysis.
Impressive implementation. You should also include how much all the API calls cost in total for a sense of where we currently stand with the technology and its accessibility.
This is easily the coolest thing I've seen in gaming ever. You should think about reaching out to game devs and offering your services integrating this into their games, im sure there are countless games that would benefit from having this type of machine interface added to them. I really cant get over how cool this is lol
OMG absolutely amazing. This must be an official feature. It would be really helpful especially to new players. Because I remember when I first downloaded the game I was very frustrated with constantly checking web for tutorials.
@@fortnight5677I've seen the leaks of the 2016 game. Glad it was completly scrapped.. looked like a crappy version of advent rising.. which is itself crappy.. the new SQ42 trailers look like a PlayStation 6 level revolutionary game in comparison
It is an honour to live with you at this time. I can't imagine a more innovative game than Star Citizen with this feature and the possibility of a GPT! And of course Skyrim ;) Und mit dem Sprung auf deutsch hats mich völlig verrissen, BIN BEGEISTERT!
Dude this is awesome! I hope CIG could work with you into implementing this fully into the game itself. I really liked the part where the AI explained where to sell the stuff, as I hate to have to alt-tab and google or even ask people in local chat.
At OpenAI's DevDay a couple days ago they said they had to choose between making ChatGPT faster or cheaper.They chose cheaper and got the cost down to 2x-3x cheaper for pay-as-you-go API calls. They said they will now pivot and work on making it faster.
For the in-ship AI model there is no need to use GPT-4. 3.5 Turbo is practically seamless as far as response time and far cheaper (literally fractions of fractions of a penny). Worry not about speed.
HCS Voice packs is currently developing something similar to this but based on their professional voice acting and ai integradtion into Voiceattack. I honestly cant wait this is the start of JARVIS
Thanks to Eleven labs, you don't need professional voice acting anymore i.e. you can just train the AI with already existing snippets of voice actors and then use TTS to extend it infinitely.
This is pretty damn cool, only thing I could say to add would be different ai voices for different roles, maybe have a handful of voices for the different atcs and such.
@@OneTwoMark Based on the way its executing commands that can be bound to keys in game, you could probably get it to target nearest enemy since thats a keybind in the game. Aiming and firing the turrets is another matter and I don't think it would be possible at the moment without multiple accounts to provide player characters to man the turrets. Once we have AI blades in Star Citizen built in which can operate the turrets and probably keybinds to go along with it, then I think this should be possible based on what was shown in the video.
A well positioned dose of AI can make the game far more immersive than it is now. I would love to walk up to the bartender in Grim Hex and ask the bartender if he knows of any criminal jobs that don't show on the MobiGlas, or being able to ask the clerk at the gun shop where I can buy a sniper rifle (even if it is at a different shop).
All we need now is the ability for a computer module in the ship to execute remote commands so that you can do other stuff while the computer does the action, imagine running your your ship, getting in range and having the computer start the engine up and open the doors for you!
if u have a second account it can be done. a player has to be in ship seat for anything to happen. the game is not coded for anything to work like that.
felt like a Voice Attack copy to begin with, but this is alot more dynamic. the information getting could prove really helpful and interesting. plus the idea of having it reply like a real conversation instead of just pre-recorded voice lines opens alot of options.
I figure that's why he pointed out that it's not the same. Voice attack takes voice to text and then hits a key. It is looking for only key phrases. Whereas this takes voice to text and then passes it to GPT. GPT is something you can communicate to. If there is an API or script or something it can be given information from it can do pretty much whatever with it.
Oh my days… this is just way too awesome! Hats off for getting this working in such an immersive way and even switching between languages seamlessly makes it even more amazing. The commands feel natural and the AI response is exactly how I would expect as well. I really would love to see this become something everyone could potentially mod into their games. I’m interested to see how their “anti-cheat” interprets this, obviously it doesn’t seem to care much at the moment but I wonder if when the game launches proper, will something like this get blocked by them? If so, I think the whole community would clamour for an official addition of this feature, adding another 10 years to SC’s development probably😅
this is pretty awesome actually. just normal old SC feels much more scifi and immersive with nothing more than some dynamic interactive AI talking man.... would love to see this as a permanent implementation to the game. Like many have said, very star trek vibes talking to the computer and giving it some commands to execute. I think when it talks back dynamically is even more immersive than the in game actions it performs funny enough, but the combo is ideal. I think SC has a fairly hefty barrier to entry too that is really neat to have commands for the 'computer' to do, like shields full aft, or all power to thrusters, landing mode, lights, ATC for stations all nice additions to the game but tedious and immersion breaking to perform when you have to look up keybinds or something, asking the computer or station though via voice? hecka cool and realistic-scifi for the more trivial tasks of operating a complex ship.
@@KhairulFadzlyAKarim If the HCS people are watching this they should know this is the future. they have the voices, they can clone them for use in their own proprietary AI and offer a "Voice Attack Service" like this.
VoiceAttack has plugin support and HCS currently is using a plugin to access the log files and the frontier API. Should not be too hard to access other APIs
This reminds me of that scene in The Office where Michael’s like “ITS HAPPENING OH GOD ITS HAPPENING”. So happy that I get to experience this kinda stuff.
What im hoping to see is speech-to-roleplay type of feature. Not everyone is confident nor has "an epic movie voice". Having an IA record you and modify what you say to fit a roleplay character of your own, would be really interesting. Players to players ship to ship hailing with such technology would feels like a true movie! Amazing video! Would you think this works in French :-D ?
@@historyman9436for some it's not just shyness, there's millions of people around the world who have a stammer, I'm one of them & the kind of idea the op is talking about would be a game changer for allowing those with a speech impairment to also join in & use voice tech like this as well.
I love how in the games lore AI is rarely used because of a mars terraforming accident 800 years ago but this lad goes and adds a star trek computer to their taurus.
I need this NOW!!!!!! I use Voice Attack which partially does some of the things you demonstrate but no interactions with stations.... This is awesome! I'm eagerly awaiting your instructional videos on how to do this.
@@Sgt_RED Setting up voice lines is time consuming especially when AI can come up with their own which aren't going be the same each time you issue the command.
I know CIG wants the Captain to be a usable functioning role for Players. Always wondered how they would set up an interface for that kinda gameplay but honestly I can see them going down a route like this
it's so immersive and good it's quite scary, on one side I want to press the button to turn lights on but also I want to talk to Computer and give him command to do it... hehehe
@@historyman9436 For clarification on what was said, general artificial intelligence was banned, not ai. AI for specific use cases is very much a thing but is heavily regulated where it's allowed. Think of it like how cars now have adaptive cruise control, lane keep and departure sensors, automatic traction control, etc but full self driving is undergoing a lot of scrutiny in legal fields right now and is beginning to be regulated. Automated turrets would fall in that complete automation heavy regulation area if they can do full target selection, prioritization, etc but if it's just whatever the pilot targets and it's just pilot controlled turret gimbals around the whole ship, that would be way less regulated.
This is so cool! And an actually useful fun looking integration that would really increase immersion. This kind of thing is what all games that use dialogue should have.
This seems so immersive and incredible. But also its implications potentially dangerous... not sure if CIG should include this or ban it immediatelly. 😅
Shit like Tobii already gives a significant advantage. Other peripherals are arguably more advantageous for certain scenarios. No reason to not have this.
@@doge5401 Well, at limited capacity yes... what I am refering to is that AI in general can be trained for games likes this. And if that would happen, it would most likely be indistinguishable from normal players. That could potentially ruin multiplayer gaming as a whole. Don't get me wrong, this is miles away from such a scenario and I would actually love to have something like this in game. But only if CIG would be in full control over what this can and can't access.
@@grahamw7657 Hard to say. I would love to have a companion like this in my helmet or my ship... But I think it would have to be very very limited. The way it is presented in the video is fairly basic, despite how incredible it sounds/seems. So, as long as it uses only in game controls and reacts only to what players say it might be just a great tool. But the fact it offers a trading route scares me. Not sure if it somehow collects from in game data, or it just searches the internet to find the answer and that is not cool honestly. Like, it could remove all the mystery/investigation from the game.
That's pretty cool and has some function but man if we can actually get banter back and forth to even perhaps local news in the sector reports that'd be cool
Yes we need our a.i. gaming companions. Very important! XD So far Bard and GPT both agreed with me it was great idea according to them some weeks ago. It's nice to see someone doing something to get the hype started :)
Looks good for a video. Don't think it will be useful in day-to-day playing due to two reasons from the top of my head. 1. Gets annoying if you need to go through the same chit chat 20 times a day leaving your hangar or doing any other repetitive activities. 2. You're gonna get blasted asway before you can say 'computer, please arm 2 flares and launch them in order to counter these two missiles approaching me' :D Nothing beats having HOSAS with shit-ton of buttons and just doing all of these in seconds.
You can do it all by yourself or tell the ai assistant. I think its a very good idea. You can tell computer do do something while your hands are busy.. Like "Give me more shields!" and the computer will reroute power etc. But it would have to have faster reaction times than this.
@@YellowKing1986OpenAI said a few days ago that they worked on making ChatGPT cheaper for developers and now that they have done that they will work on making it faster.
Don’t get me wrong, I’m happy if more people use that and wait for the AI to process their command for shield change as I fire away at them :) It’s cool for crusing peacefully around. For dogfighting or any combat scenario it is way too slow. Waaaaay too slow.
Whats funny is about 20 years ago i used voice software to control my games and i had to code it too....and now look AI is a thing. The world we live in amazes me, also amazing to see how far this game has gone
In my opinion at this point in time the best use of this will be at kind of helping new players get a hang of the games mechanics and world. I cant tell you how many games i've played where i wish i knew how to do something, and could just ask someone, it would really help at making game that feel too complicated or intimidating feel less overwhelming to tackle.
utterly brilliant, I am especially interested in learning more about how you drive the voice synthesis with such superb voices and vocal effects. Outstanding, thanks for sharing.
Lol my hobby since Chat GPT came out was making my own personal databases for games i play for Chatgpt to use as a framework to serve this very purpose for whatever game i decide to play! Unfortunately, i am dumb and poor. Glad to see smarter and richer folks caught my brain wave! Might even get into this game
This looks awesome and possibilities are endless. One issue is the computing power. As I understand it using GPT for this requires paying extra for it. Now if someone made some more specialized AI model it would be possible to run it locally and making it specialized would cut down the processing power it needs. In a few years from now people will have faster computers than they have now so that is a temporary issue anyways. The biggest problem will be drawing a line somewhere and making rules around it. It is something that can give a huge advantage for the player and in an online game that is an issue. Some people will at some point figure out how to make it farm resources or something while they are afk and we may end up with AI-powered bots that will be extremely hard to tell apart from real players.
Yep, the cost here is probably quite high. GPT 4 turbo costs about 1 cent per 1k input tokens and 3 cents for 1k output tokens. 1000 tokens is about 750 words. The speech to text model from open AI costs 0.6 cents per minute and the text to speech is at about 1.5 to 3 cents per 1k characters. So likely a few cents per interaction since this will have to send a lot of data additional to just the spoken text My hope is that OpenAI will get the cost of GPT-4 down to the current pricing of GPT-3.5 . Currently this is about 10x cheaper.
AI, over the next 15 years is going to revolutionize a lot of society. Starting with video games and other forms of entertainment people view in the privacy of their rooms and hastily expanding to nearly every facet of society. Your phone will be your talking companion, your car GPS/Audio system can have its own personality, the check out counter at a store, training programs, movies/TV, etc.
FANTASTIC! Of course, this all goes pear-shaped every other week when SC changes their keybinds :) Is this going to be free or is there going to be a fee? Also, is it supported when the keybinds are changed (that seems to be the biggest hassle I have rn)? How will this handle my custom binds? Will there be a local client installed for that or will I have to change my keybinds to something standard? Is there a timeline for this?
Cooles Video! Nice work, i really liked the trading assistence feature. Provided the AI could get real data from ingame from a scan, the exploration side of the game would benefit a lot.
Just starting the video, but just based on the introduction and the idea, I could see this also being implemented for AI pirates or AI police. It would add value to the "hail" feature on the ship with NPCs. I imagine the AI could have a base line personality of aggressiveness on whether they're willing to negotiate you giving items instead of just blowing you out of the air. Or if you were bounty hunting an AI, it could provide the player an opportunity to negotiate the target to turn themselves in without a struggle. Getting the system right so it's not easy to manipulate and provides unique character to each interaction could be tricky, but I could see it working in the near future (next few years). I think AI is going to provide a major breakthrough in how we interact with NPCs and I wouldn't be surprised to see Star Citizen to be one of the first to experiment and spearhead that movement.
The possibilities here are immense. Imagine walking around the ship doing other tasks all while issuing commands to be jumping around to various places in space without ever having to touch the control. Or returning to a station for the first time in a while and the ATC greets you with familiarity, knowing that you hadn't been there in awhile. Or you're in the middle of a firefight on a planet and you have the ship fly in and pick you up, drop ordinance, or squadmates, just to scratch the surface.
This is cool. Seems to be a slightly more immersive voice commander type software. The trade route seems to be different, but to me it looks like a static route. Maybe if it pulled info from sc-trade tools or c-stone, that would be awesome as those folks keep updated info all the time. Otherwise, because of TOS concerns it is basically a voice commander. I assume it was looking for a ship signal by screen reading in the radar section. That is dangerously close to TOS violations if that is the case. Until SC puts together an API for use with programs like this and game glass, we can't be sure what will be allowed. Honestly, I would rather use game glass and my controllers to do the simple button presses, but have something like this giving status notifications and alerts. The ATC banter I would love to see in the game proper.
This is what Star Citizen needs for more realistic spaceport/hanger/docking feelings. That and bigger ships need more power up buttons, i absolutely hate the idea of a single flight ready button.
The minute long exchange just to say "bye" leaving the hangar, like who's going to have the last word or "Hang up first" "No you♥". I am a bit mixed on the on-bard voice commands. I worry that at some point you won't be playing but setting up a bot, but I like the idea to remote control ramps to open as you walk to get ready instead of finding the right button.
Star Citizen gonna be a phenomenal game ever made when its fully release. also one more thing is we need an AI that can control the turret so a solo player can fly carrack or hammerhead with all weapon activated
VoiceAttack already did this a long time ago for Star Citizen and Elite Dangerous along with HCS Voice Packs for lines from professional actors/actresses. So it's not exactly a new idea, but combining ideas from this and VoiceAttack seems like it would result in the perfect solution, because the voice recognition seems better in this.
Wingman AI is OUT NOW! Check it out at ruclips.net/video/temLcjFDiVU/видео.html
THIS IS INCREDIBLE. EXACTLY what Star Citizen is missing with immersion and ease of access at times. But this would completely change the game for me. CIG has to see this immediately!!! 🤩
When Chris saw Hybrid Audio's realistic immersion sound video he had the sound team add a realistic sound module to the game exactly how it was designed in Hybrid Audio's video. So if this gets enough traction and Chris sees it, it's pretty much 100% guaranteed it will end up in the game.
@@Billy-bc8pkand another delay😂
@@CheapoAssit will not delay server meshing team or pyro team etc. This tech needs to happen. Even though voice attack exist on steam for a cheap price
Chat gpt is actually pretty expensive for business use, especially chat-gpt 4. If CIG can make it work great, but I hope they do the due diligence on cost first
Yeah but those useless old farts both at CIG and in the community don't want it.
I suggested something like this months ago and people didn't want it.
I think this could be interesting for a Star Trek kind of experience as the captain, ordering crew mates to do certain tasks while maintaining your own, etc.
Could be used to giving orders to npc's on a big multi crew ship.
I was going to say, a large as fuck capital ship listed as only having a single required crew member. It's entirely run through voice commands and such, but has the downside of being significantly slower to respond to certain actions, while also being able to avoid obstacles and seeing the context of what's in view of the ship and such while you can just run around the bridge, faffing about.
@@NatjoOfficialThe problem lies in the actual complex tasks that need to be done.. like maintenance.. as none of these things are just.. artificial.. but ohysical tasks that need to be done. You would really need a lot of NPCs actually running arround checking etc. A bolted on AI could never manage.. or would be waaaay to expencive.. This would be needed to be done in engine with task specific software... and still be REAL heavy on the servers!
A.I generated stuff in star trek bridge crew would be amazing and is the game i assume you are talking about
@@robertpatrick5861 not necessarily. You don’t need multiple GPTs running around doing stuff, you just need a single GPT controlling and sending out pretty rudimentary NPCs to do the tasks that need to be done, or for certain things simply a counter with “NPCs” available for a task and then a countdown to when that NPC is available again. It doesn’t need to be insanely complicated.
Plus, you’d only need really the input interpretation of the GPT which is one of the lighter weight parts of it and something we’ve put in games before. Give the AI some basic pre-made voice lines, or even a text to speech bot which can generate from pre-made sentences cobbled together like “[fire detected in] [cargo hold]”.
(Tbh, I don’t think it even requires a GPT at that point…)
you need to show this to the devs and see if you can sell it to them or something, this is absolutely genius
there are no IA in starcitizen lore
If a user knows it I'm pretty sure the devs at CIG are all well aware of it as well.
@@jesfr3236 if we are just talking about the ATC Contatcs: its not AI inside SC its a AI here in real life just controlling the NPC so its no AI in SC Lore its just Game Tech
For the Ship Controle yes this is against Lore
no its not, every moddingcommunity is using ai since the first became popular, skyrim hello?
mate the devs have enough problems this will only set them back another 12 years and 5 game engines.
It cannot be overstated how much this will change gaming in the next decade. AI crew, companions, settlers, enemies. Your companions will remember everything you have been through together in game, will have unique personalities tailored to you, and actual conversational abilities. Prerecorded dialogue and interaction trees will no longer be needed. Missions will have nearly endless nuance, making them all unique to the player while progressing a wider storyline. NPCs will all be running basic neural nets giving them unique environmental and situational awareness/reactions. Graphics will become even more lifelike using generative AI to polish the GPU-generated graphics. There will be endless AI-generated side quests, the list goes on and on.
It will need to be worked on a great deal with some railroading for important story beats, if you've ever sat and tried to RP with AI it often forgets, misunderstands and outright curbs the conversation with unrelated topics. It'd be nice in small doses, but running major game systems with this would be asking for failure.
@@Sm0lPerson What you are playing with are very rough prototypes with garbage user interface.
They're already are multimodal LLAMA agent swarms, I read about four different memory optimizations just this morning in white papers.
Just this morning a single small file made SDXL 10x faster. Even a 3060 can spit out an image every couple of seconds.
Instead of having a guess what sampler works best with what model you can just try all the samplers in less time that it takes to make a cup of coffee.
It doesn't just make the images generate faster it makes the entire process 10x better for the same compute.
Same thing for LLMs. LLMs still don't have it's "ComfyUI" yet. There is still a lot of very low hanging fruit, and lots of interested developers.
@@Sm0lPerson Yeah of course. I don't think anyone is saying this is ready for production it is more of a glimpse into the future of gaming and NPC interaction. It will likely be an add-on/modded feature to begin with, most likely accompanied by a monthly fee, soon followed by AI-generated DLC or mods then finally integrated into a game at launch. This is likely the worst it will ever be which, as a gaming enthusiast, is incredibly exciting.
@@Sm0lPerson like already mentioned your referring to outdated, obsolete and likewise poorly setup ai platforms, you also have allot of people even charging subs and other fees as well for junk ai, because they know your average consumer is clueless, even to the fact its possible to run them on a home PC, which means most AI platforms especially on any app store have a mandatory online service model, not only to milk your wallet to unlock their features etc, but also to collect and sell your data, which they cant milk if its released as a standalone download, so they not only prey of consumer ignorance, they also feed it through mis-information as well.
The problem is computing power. ChatGPT needs tons of video cards to run.
LIVE:
UPDATE:
We are thrilled to announce, that we are one step away from releasing our first version of WingmanAI! Currently we are in polishing phase and are planning to get feedback from our Patreons (as early access testers) earlier next week.
If there are no major issues, we plan to release the first version to the public next Friday. To give you some insights on what to expect, here is a list of features that will be included in the first release:
- Talk to different AI characters
- Create / Modify your own AI characters
- Support of multiple AI characters (each has its own configuration and history)
- Define commands and keybindings which can be triggered by the AI characters
- Define instant action commands which can be defined by phrases and are triggered faster (like VoiceAttack)
- Enable / Disable audio effects
- Plugin system to extend the functionality of WingmanAI and implement your own logic (including API calls etc.)
- Multiple languages, even on-the-fly switching in conversations
We are really looking forward to your feedback and your ideas on how to improve WingmanAI.
Again, thank you so much for your amazing support! It really means a lot to us
Have a wonderful weekend!
--Original Post:
Hello everyone. We are absolutely overwhelmed by the response and your feedback. We try to read every single feedback and update this pinned comment to a little Q&A ;-)
1. "How did you do it?"
We're currently working on a series of follow-up videos to show you exactly how we did it and how you can do it too.
2. "It's like Voice Attack!"
It's similar to Voice Attack, sure. The main difference is: you're actually talking to GPT-4 Turbo, which means: you don't have to say a specific keyword or command. You can, of course, talk to an AI and talk about anything in your mind.
3. "The response time is not fast enough."
Yes, this could be improved in the future. But we already have prototypes that shorten the response time. And we will definitely talk about this in one of our next videos.
4. "This is not the Seraphim Station!"
No, it's absolutely not ;-) To be honest: At the time of recording, I didn't know the name of this pyro station yet, so I just called it Seraphim Station. But that doesn't really matter, because the AI doesn't know anything about it either.
5: "How can the AI react to the scan results?"
It can't at the moment because Star Citizen doesn't have an API or anything like that. GPT just made up a response, that's all. And yes, that is a bit arbitrary and not correct.
Thanks again for your feedback and let's see in the next video ;-)
please post vids on how to set this up. it feels better than voice attack, as i cant always remember the exact phrase to use with voice attack
So for number five scan results why not have the ai respond with something like please refer to your dispaly or hud for results? or I have marked them on your display.
@@LevelGroundGamer you can simply train the AI to do just that. Like say a phrase to it "from now on anytime you do a scan tell me to check the hud". It's very teachable. Only issue is it does "hallucinate" quite easily so you would have to refresh what you taught it from time to time. I have a script I run every time I run out of tokens (although now it has significantly more tokens to use).
Hey, I love this idea. Can this be set up to allow chatgpt to control actual player accounts? Because if so I want it
Hmm… can I use it even if I’m not in the captain seat? Also is this useable in game? Like can I use it? And is it considered cheating?
The beauty of this, is there's no one way to talk to the AI, the complexity of how you use it, can dynamically scale, to how you talk to it. If you want full ATC mode, it can do it, but if you want to simply turn on the engines, it can do that too, and unlike a typical game mechanic, you're not required to do either.
Yes, and you can change this to your liking. It’s basically just a GPT Promt shaping the ‘character’ of the AI.
@@ShipBit only missing the API access for better feedback and control. Hopefully in the future, we see more of this type of NPC interaction in games, as well as the NPC conversations.
And it would also be nice to be feeded by cornerstone and erkul
Wow, did not expect to see something so badass today... Stoked to see where you take it!
I thought you had stopped playing this many moons ago? Or do I have the wrong person?
Well I never really started until this year, now this is the only thing I play. Assuming this is the pilot I called Khruu/4th, you got the right guy. @@chrisdavis7533
It's like an improved VoiceAttack... very nice.
An immersive VocieAttack with a relative locational knowledge database
Excited to see if this will be progresed into a true Verse'Companion
Just a lot more expensive at $20 a month. But truly interesting for the future.
@@MrTree421For people like me who are already paying the $20 a month for using GPT-4 for other things I'd love this to get more of my money's worth!
@@MrTree421 It's actually $5.99/month or $59.99/year ;)
Wow, just wow!! This has the potential to be a total game changer! Full immersion. Seriously mind blown right now!!
Voiceattack evolution. It never stops to amaze me what the star citizen community does.
The big difference between this and VA is that there isnt a need to train the onboard hardware to map your voice, the AI just runs it itself and has a very good confidence level on these commands. Also non-scripted responses... just insane. Switching to other languages on the fly is just showing off.
NO
This thing has huge potential. given the spending attitude of RSI customers and the potential of this work, I hope you think about creating a specific app. It has a lot of potential and real utility.
An AI that can connect from the ship, to the helmet when you are outside the ship, is very useful. excellent earning potential.
and choose which is the best depending on the parameters you enter. the voiceattack is just a repetition of instructions, here the APIs provide data and information to a system that can MANAGE AND MANIPULATE them.
it's absolutely not the same thing.
@@Norman_Peterson I think that's why the comment said "evolution," either way I agree... this is absolutely amazing. The potential is immense.
The folks at voice attack need to be paying very close attention to this. This is the direction that should be moving
Well this is just an excellent example of the power of the new openAI custom GPTs and the native JSON outputs with no latency and mutliple function calling at once can be now be utlised, im assuming this is using the openAI whisper API as well with the new GPT 4 model. Pretty damn cool if you ask me. Iv been watching all the use cases pop up over the last few days but this one i did not expect, nice work.
There is a delay between communication with the AI, but hopefully that can be fixed.
The title of the video says it is using ChatGPT Turbo.
what’s a jason output?
The delay will get better. The new 4 turbo model that he’s likely using has yet to be optimized for speed ( been optimized for sophistication and lower cost first). Also he’s recording his speech and then sending the GPT an audio file to analyze first. Great pattern for a compelling technology proof and when he or someone else takes it to the next step they will likely stream the audio into a separate speech-to-text agent and then pass the text to the GPT. That will reduce the time delay significantly. The thing to call out here is that he built, in under a week (the tools he’s using were released from OpenAI on Monday), a break-through compelling immersive experience, the likes of which have never existed in the gaming world. Fucking Bravo Zulu!
@@richardcharlesworth2020 According to ChatGPT 4 itself:
Whisper, an automatic speech recognition system, works by converting your speech to text before it's analyzed by systems like ChatGPT. Here's how the process typically works:
1. **Speech Recording**: Your speech is recorded via a microphone or other recording device.
2. **Speech Recognition**: The recorded audio is processed by Whisper, which uses advanced algorithms to transcribe the speech into text. This conversion happens locally on your device or on a server, depending on the specific implementation.
3. **Text Analysis**: Once your speech is converted to text, this text is then sent to ChatGPT or similar systems for analysis and response generation.
This process ensures that the language model (like ChatGPT) only deals with text input, maintaining a consistent mode of operation regardless of whether the original input was typed or spoken. The key advantage here is in maintaining user privacy and data security, as only the transcribed text, not the actual audio file, is sent for analysis.
Have to say I loved it. Communicating with flight control makes it so much more immersive.
Impressive implementation. You should also include how much all the API calls cost in total for a sense of where we currently stand with the technology and its accessibility.
This is easily the coolest thing I've seen in gaming ever. You should think about reaching out to game devs and offering your services integrating this into their games, im sure there are countless games that would benefit from having this type of machine interface added to them. I really cant get over how cool this is lol
OMG absolutely amazing. This must be an official feature. It would be really helpful especially to new players. Because I remember when I first downloaded the game I was very frustrated with constantly checking web for tutorials.
This is what a "next-gen" game would implement. Love you guys for taking this endeavour on and demo'ing it. CIG, i hope you're taking notes!
I hope next years citizencon is just as good as this years.. but a lot of it's about dramatically better A.I. You can talk to and hire
Probly will be big as squadron will either be out or about it around that time
@@SatoriLuvTheFlex I thought you were supposed to Answer The Call in 2016?
@@fortnight5677 That was the plan, until the community demanded the game be expanded and planet tech came online
@@fortnight5677I've seen the leaks of the 2016 game. Glad it was completly scrapped.. looked like a crappy version of advent rising.. which is itself crappy.. the new SQ42 trailers look like a PlayStation 6 level revolutionary game in comparison
It is an honour to live with you at this time. I can't imagine a more innovative game than Star Citizen with this feature and the possibility of a GPT! And of course Skyrim ;) Und mit dem Sprung auf deutsch hats mich völlig verrissen, BIN BEGEISTERT!
Dude this is awesome! I hope CIG could work with you into implementing this fully into the game itself. I really liked the part where the AI explained where to sell the stuff, as I hate to have to alt-tab and google or even ask people in local chat.
Thats pretty wild..The only issue is processing delay time. Im sure over time GPT will get faster but wow pretty insane.
At OpenAI's DevDay a couple days ago they said they had to choose between making ChatGPT faster or cheaper.They chose cheaper and got the cost down to 2x-3x cheaper for pay-as-you-go API calls. They said they will now pivot and work on making it faster.
I think for ATC calls the response delay is fine, but for the bord computer not ^^
@@TheKorbi A delay in ATC calls is absolutely fine by me. Feels more realistic imo
For the in-ship AI model there is no need to use GPT-4. 3.5 Turbo is practically seamless as far as response time and far cheaper (literally fractions of fractions of a penny). Worry not about speed.
The trading office bit and then doing it in german blew my mind.
HCS Voice packs is currently developing something similar to this but based on their professional voice acting and ai integradtion into Voiceattack. I honestly cant wait this is the start of JARVIS
Thanks to Eleven labs, you don't need professional voice acting anymore i.e. you can just train the AI with already existing snippets of voice actors and then use TTS to extend it infinitely.
@jean-lucpicard581 yep, we’re already working on 11Labs in Wingman!
This is pretty damn cool, only thing I could say to add would be different ai voices for different roles, maybe have a handful of voices for the different atcs and such.
I’ve wanted this for SO LONG, i just didn’t know it was possible. This is amazing.
Holy shit this is amazing. I want this in my Star Citizen life right now! You sir, are a genius.
Can it target nearest enemy and fire remote turrets?
@@JustThisGuy42 Lol obviously not.
@@OneTwoMark Based on the way its executing commands that can be bound to keys in game, you could probably get it to target nearest enemy since thats a keybind in the game. Aiming and firing the turrets is another matter and I don't think it would be possible at the moment without multiple accounts to provide player characters to man the turrets. Once we have AI blades in Star Citizen built in which can operate the turrets and probably keybinds to go along with it, then I think this should be possible based on what was shown in the video.
A well positioned dose of AI can make the game far more immersive than it is now. I would love to walk up to the bartender in Grim Hex and ask the bartender if he knows of any criminal jobs that don't show on the MobiGlas, or being able to ask the clerk at the gun shop where I can buy a sniper rifle (even if it is at a different shop).
All we need now is the ability for a computer module in the ship to execute remote commands so that you can do other stuff while the computer does the action, imagine running your your ship, getting in range and having the computer start the engine up and open the doors for you!
if u have a second account it can be done. a player has to be in ship seat for anything to happen. the game is not coded for anything to work like that.
I gotta have this. Flying across the Milky Way in Elite with no-one to talk to except my ships computer was some of the most fun I've had in a sim.
felt like a Voice Attack copy to begin with, but this is alot more dynamic. the information getting could prove really helpful and interesting. plus the idea of having it reply like a real conversation instead of just pre-recorded voice lines opens alot of options.
I figure that's why he pointed out that it's not the same. Voice attack takes voice to text and then hits a key. It is looking for only key phrases. Whereas this takes voice to text and then passes it to GPT. GPT is something you can communicate to. If there is an API or script or something it can be given information from it can do pretty much whatever with it.
Oh my days… this is just way too awesome! Hats off for getting this working in such an immersive way and even switching between languages seamlessly makes it even more amazing. The commands feel natural and the AI response is exactly how I would expect as well. I really would love to see this become something everyone could potentially mod into their games. I’m interested to see how their “anti-cheat” interprets this, obviously it doesn’t seem to care much at the moment but I wonder if when the game launches proper, will something like this get blocked by them? If so, I think the whole community would clamour for an official addition of this feature, adding another 10 years to SC’s development probably😅
I am really looking forward to the point when we can actually have conversations in games by just talking to NPCs. Great Job!!!
i think i prefer the speed of VoiceAttack for the ship functions, but asking the computer for trade routes and the like is pretty neat!
The speed is not a problem, AI will become faster and faster. For now it's slow, but in a few months/years it will be very fast.
but do they actualy are acurate?
if so its brilliant. I got VA and I love but this Sir is way to crazy.
I have been testing this for a couple days now and.... WOW! I'm blown away! This takes everything to another level!!
this is pretty awesome actually. just normal old SC feels much more scifi and immersive with nothing more than some dynamic interactive AI talking man.... would love to see this as a permanent implementation to the game. Like many have said, very star trek vibes talking to the computer and giving it some commands to execute. I think when it talks back dynamically is even more immersive than the in game actions it performs funny enough, but the combo is ideal. I think SC has a fairly hefty barrier to entry too that is really neat to have commands for the 'computer' to do, like shields full aft, or all power to thrusters, landing mode, lights, ATC for stations all nice additions to the game but tedious and immersion breaking to perform when you have to look up keybinds or something, asking the computer or station though via voice? hecka cool and realistic-scifi for the more trivial tasks of operating a complex ship.
Blew me away with the seamless language transition. Bravo, very well done!
I've been using VoiceAttack but I would definitely love to replace it with this! AI is the future.
Could they add those together, I love Voice attak voices, imagine having obsidian ant ai actually conversing.
@@KhairulFadzlyAKarim If the HCS people are watching this they should know this is the future. they have the voices, they can clone them for use in their own proprietary AI and offer a "Voice Attack Service" like this.
VoiceAttack has plugin support and HCS currently is using a plugin to access the log files and the frontier API. Should not be too hard to access other APIs
This reminds me of that scene in The Office where Michael’s like “ITS HAPPENING OH GOD ITS HAPPENING”. So happy that I get to experience this kinda stuff.
What im hoping to see is speech-to-roleplay type of feature. Not everyone is confident nor has "an epic movie voice". Having an IA record you and modify what you say to fit a roleplay character of your own, would be really interesting.
Players to players ship to ship hailing with such technology would feels like a true movie!
Amazing video! Would you think this works in French :-D ?
That's a very interesting concept, actually.
Yes it also works in French ;-) And yes: Interesting thought…
What the fuck omg the soy
It would also help those that are sorta shy to also talk ingame
@@historyman9436for some it's not just shyness, there's millions of people around the world who have a stammer, I'm one of them & the kind of idea the op is talking about would be a game changer for allowing those with a speech impairment to also join in & use voice tech like this as well.
I love how in the games lore AI is rarely used because of a mars terraforming accident 800 years ago but this lad goes and adds a star trek computer to their taurus.
I need this NOW!!!!!!
I use Voice Attack which partially does some of the things you demonstrate but no interactions with stations.... This is awesome!
I'm eagerly awaiting your instructional videos on how to do this.
you can do this with voice attack aswell.
you just have to set up voicelines that react to these specific ones you say.
@@Sgt_RED Yes, i understand. but you can't get Trades routes info ... This is way more in depth
This doesn’t actually add any interaction with stations, it’s all just chatbot fluff.
@@Sgt_RED Setting up voice lines is time consuming especially when AI can come up with their own which aren't going be the same each time you issue the command.
All true, but are you willing to fork out 20 a month for that?
This really puts a whole new level to the game! Very excited to see this and want to use it when available.
I know CIG wants the Captain to be a usable functioning role for Players. Always wondered how they would set up an interface for that kinda gameplay but honestly I can see them going down a route like this
it's so immersive and good it's quite scary, on one side I want to press the button to turn lights on but also I want to talk to Computer and give him command to do it... hehehe
AI is outlawed in the game lore. The developers have said having AI run everything would make a boring game.
Then we'll do it ourselves lmao
AI is literally planned to be an option to man your turrets in future. A cheaper option of NPCs. Its gonna be AI > NPC > Player for effectiveness.
@@OneTwoMark If OP is right, I presume that running the AI turrets will be either susceptible to you skirting the law, or the lore will be adjusted
It clearly isn’t in this scenario it’s incredibly useful and enhances immersion. If anything, this makes the experience much more exciting
@@historyman9436 For clarification on what was said, general artificial intelligence was banned, not ai. AI for specific use cases is very much a thing but is heavily regulated where it's allowed. Think of it like how cars now have adaptive cruise control, lane keep and departure sensors, automatic traction control, etc but full self driving is undergoing a lot of scrutiny in legal fields right now and is beginning to be regulated. Automated turrets would fall in that complete automation heavy regulation area if they can do full target selection, prioritization, etc but if it's just whatever the pilot targets and it's just pilot controlled turret gimbals around the whole ship, that would be way less regulated.
This is so cool! And an actually useful fun looking integration that would really increase immersion. This kind of thing is what all games that use dialogue should have.
This seems so immersive and incredible. But also its implications potentially dangerous... not sure if CIG should include this or ban it immediatelly. 😅
Shit like Tobii already gives a significant advantage. Other peripherals are arguably more advantageous for certain scenarios. No reason to not have this.
Could something like this be client side only? To mitigate risk.
@@doge5401 Well, at limited capacity yes... what I am refering to is that AI in general can be trained for games likes this. And if that would happen, it would most likely be indistinguishable from normal players. That could potentially ruin multiplayer gaming as a whole.
Don't get me wrong, this is miles away from such a scenario and I would actually love to have something like this in game. But only if CIG would be in full control over what this can and can't access.
@@grahamw7657 Hard to say. I would love to have a companion like this in my helmet or my ship... But I think it would have to be very very limited. The way it is presented in the video is fairly basic, despite how incredible it sounds/seems. So, as long as it uses only in game controls and reacts only to what players say it might be just a great tool.
But the fact it offers a trading route scares me. Not sure if it somehow collects from in game data, or it just searches the internet to find the answer and that is not cool honestly. Like, it could remove all the mystery/investigation from the game.
That's pretty cool and has some function but man if we can actually get banter back and forth to even perhaps local news in the sector reports that'd be cool
That looks amazing, i am very curious to see the next videos and how to implement it.
The completely blew me away! Tony Z needs to get his hands on this to complete the economy AI
Yes we need our a.i. gaming companions. Very important! XD So far Bard and GPT both agreed with me it was great idea according to them some weeks ago. It's nice to see someone doing something to get the hype started :)
imagine if they intergrated this into the game, it would only add another 4 years to development, nothing really.
Woah imagine integrating AI commands with the NPC Crew assigning tasks. Man this game did just become so much better.
Looks good for a video. Don't think it will be useful in day-to-day playing due to two reasons from the top of my head.
1. Gets annoying if you need to go through the same chit chat 20 times a day leaving your hangar or doing any other repetitive activities.
2. You're gonna get blasted asway before you can say 'computer, please arm 2 flares and launch them in order to counter these two missiles approaching me' :D Nothing beats having HOSAS with shit-ton of buttons and just doing all of these in seconds.
You do understand that this is optional, right? Obviously you can still operate everything via the keyboard etc...
It's meant to be immersive.
You can do it all by yourself or tell the ai assistant. I think its a very good idea. You can tell computer do do something while your hands are busy.. Like "Give me more shields!" and the computer will reroute power etc. But it would have to have faster reaction times than this.
@@YellowKing1986OpenAI said a few days ago that they worked on making ChatGPT cheaper for developers and now that they have done that they will work on making it faster.
Don’t get me wrong, I’m happy if more people use that and wait for the AI to process their command for shield change as I fire away at them :) It’s cool for crusing peacefully around. For dogfighting or any combat scenario it is way too slow. Waaaaay too slow.
Whats funny is about 20 years ago i used voice software to control my games and i had to code it too....and now look AI is a thing. The world we live in amazes me, also amazing to see how far this game has gone
Was chugging a bit there at the start but man does this look really awesome. Future of gaming.
Imagine NPCs actions and conversations controlled with these new AI technologies. Including plot scenarios and missions.
This is so beyond next level man!
DAyum!!!!!!!! Finally here in a pocket sized box. Glad I lived to see it but also worried about the future. Thank You for sharing! Grüße und Danke!
well, this is the future of gaming. Incredible work. WOWZERS!
I'm not sure I'd use it because the hotkeys seem like they'd be faster in most situations, but this is amazing for accessibility. Good work.
I never turn my ship off because tis so much work. This would be amazing to have multiple ways to do it. Way more fun this way.
Talking with the station control was very cool. But I’ll never talk to my ship 😂
This, along with machine vision and image/3d generation, will absolutely change the face of gaming.
Damn, this is absolutely fantastic and adds a greatly needed addition to our fantastic game, Well Done to you Good Sir
Ship avoid impact with meteorite.
Ship: I can't do this Dave.
I've always wanted this in a space game!! Can't wait for your videos on how to implement
This is soooo gooood! Can’t wait to find out how to do this myself
In my opinion at this point in time the best use of this will be at kind of helping new players get a hang of the games mechanics and world.
I cant tell you how many games i've played where i wish i knew how to do something, and could just ask someone, it would really help at making game that feel too complicated or intimidating feel less overwhelming to tackle.
Impressive. Now we need this for NPCs within the space stations & outposts :)
utterly brilliant, I am especially interested in learning more about how you drive the voice synthesis with such superb voices and vocal effects. Outstanding, thanks for sharing.
Wow echt gute Arbeit. Dafür, dass Du die Wandlung über die einzelnen Tools hast, ist der Delay echt kurz. Super Arbeit, Sub kriegt ihr.
Hold please, while I collect my jaw from the floor. the trade info interaction at 4:52 blew my mind.
Being able to do this would entice more players to SC in so many ways!!! Chris are you paying attention?
hands down beat thing i have seen in a while, it gets hell lot immersive. Imagine a AI combat UI guiding realtime in a tactical shooting?
Lol my hobby since Chat GPT came out was making my own personal databases for games i play for Chatgpt to use as a framework to serve this very purpose for whatever game i decide to play! Unfortunately, i am dumb and poor. Glad to see smarter and richer folks caught my brain wave! Might even get into this game
This looks awesome and possibilities are endless. One issue is the computing power. As I understand it using GPT for this requires paying extra for it. Now if someone made some more specialized AI model it would be possible to run it locally and making it specialized would cut down the processing power it needs. In a few years from now people will have faster computers than they have now so that is a temporary issue anyways. The biggest problem will be drawing a line somewhere and making rules around it. It is something that can give a huge advantage for the player and in an online game that is an issue. Some people will at some point figure out how to make it farm resources or something while they are afk and we may end up with AI-powered bots that will be extremely hard to tell apart from real players.
Yep, the cost here is probably quite high.
GPT 4 turbo costs about 1 cent per 1k input tokens and 3 cents for 1k output tokens. 1000 tokens is about 750 words.
The speech to text model from open AI costs 0.6 cents per minute and the text to speech is at about 1.5 to 3 cents per 1k characters. So likely a few cents per interaction since this will have to send a lot of data additional to just the spoken text
My hope is that OpenAI will get the cost of GPT-4 down to the current pricing of GPT-3.5 . Currently this is about 10x cheaper.
AI, over the next 15 years is going to revolutionize a lot of society. Starting with video games and other forms of entertainment people view in the privacy of their rooms and hastily expanding to nearly every facet of society. Your phone will be your talking companion, your car GPS/Audio system can have its own personality, the check out counter at a store, training programs, movies/TV, etc.
Incredible job with the backend. Smooth. 👏🏻
Imagine this in a dogfight!
"computer, divert all power to guns and shields!"
"Power diverted."
FANTASTIC! Of course, this all goes pear-shaped every other week when SC changes their keybinds :) Is this going to be free or is there going to be a fee? Also, is it supported when the keybinds are changed (that seems to be the biggest hassle I have rn)? How will this handle my custom binds? Will there be a local client installed for that or will I have to change my keybinds to something standard? Is there a timeline for this?
Cooles Video! Nice work, i really liked the trading assistence feature. Provided the AI could get real data from ingame from a scan, the exploration side of the game would benefit a lot.
Simply amazing!
Unbeliveble I live to see this hapenning!
Awesome Awesome Awesome - This is the missing link that will finally turn Star Citizen into a game. Love it.
Just starting the video, but just based on the introduction and the idea, I could see this also being implemented for AI pirates or AI police. It would add value to the "hail" feature on the ship with NPCs. I imagine the AI could have a base line personality of aggressiveness on whether they're willing to negotiate you giving items instead of just blowing you out of the air. Or if you were bounty hunting an AI, it could provide the player an opportunity to negotiate the target to turn themselves in without a struggle. Getting the system right so it's not easy to manipulate and provides unique character to each interaction could be tricky, but I could see it working in the near future (next few years).
I think AI is going to provide a major breakthrough in how we interact with NPCs and I wouldn't be surprised to see Star Citizen to be one of the first to experiment and spearhead that movement.
The possibilities here are immense. Imagine walking around the ship doing other tasks all while issuing commands to be jumping around to various places in space without ever having to touch the control. Or returning to a station for the first time in a while and the ATC greets you with familiarity, knowing that you hadn't been there in awhile. Or you're in the middle of a firefight on a planet and you have the ship fly in and pick you up, drop ordinance, or squadmates, just to scratch the surface.
i would love a form or iron man's jarvis to be able to talk to in games like star citizen. that sounds downright wonderful
This is cool. Seems to be a slightly more immersive voice commander type software. The trade route seems to be different, but to me it looks like a static route. Maybe if it pulled info from sc-trade tools or c-stone, that would be awesome as those folks keep updated info all the time.
Otherwise, because of TOS concerns it is basically a voice commander. I assume it was looking for a ship signal by screen reading in the radar section. That is dangerously close to TOS violations if that is the case. Until SC puts together an API for use with programs like this and game glass, we can't be sure what will be allowed.
Honestly, I would rather use game glass and my controllers to do the simple button presses, but have something like this giving status notifications and alerts.
The ATC banter I would love to see in the game proper.
This is what Star Citizen needs for more realistic spaceport/hanger/docking feelings. That and bigger ships need more power up buttons, i absolutely hate the idea of a single flight ready button.
10 more years of development it is!
Me: Computer can you remove that area for me please?
AI: absolutely captain. Removing area
The minute long exchange just to say "bye" leaving the hangar, like who's going to have the last word or "Hang up first" "No you♥". I am a bit mixed on the on-bard voice commands. I worry that at some point you won't be playing but setting up a bot, but I like the idea to remote control ramps to open as you walk to get ready instead of finding the right button.
This is amazing! Can't wait for your next video!
This is genius. Talk about immersion. Looking forward to learning how to add this feature.
Keeping an eye on this for sure.
Davon hab ich als Kind geträumt... krass!
This is what I dreamed of as a child... love it
Thanks a Lot! You just set SQ42/SC Back another 5 years
That is truly amazing. I really hope this inspires CIG. Thank you.
Star Citizen gonna be a phenomenal game ever made when its fully release. also one more thing is we need an AI that can control the turret so a solo player can fly carrack or hammerhead with all weapon activated
VoiceAttack already did this a long time ago for Star Citizen and Elite Dangerous along with HCS Voice Packs for lines from professional actors/actresses. So it's not exactly a new idea, but combining ideas from this and VoiceAttack seems like it would result in the perfect solution, because the voice recognition seems better in this.
This is the most incredible thing I've ever seen