Видео

Yes, github.com/KoljaB. No code for this one up yet tho, bcs it's too early work state

Sorry, can't help. I have nothing to do with MoneyPrinterTurbo. This is a translation example as showcase for my TurnVoice GitHub project.

You gotta put the pexels API key in quotes like this - """ pexels_api_keys = [ "nE113EOVlRVbpWvRE0yZFuy6KmM9WAqvelyadayadayada",] """.

Yes, it does. Voicebased or via escape key. See: ruclips.net/video/uQ8jJtalc9M/видео.html

Codebase for this: github.com/KoljaB/EmoTTS It uses OpenAI. Ollama is best choice I think for local models. You're right about maintaining AI projects ends up in dependency nightmares. Of course you can set fixed versions, but if not all dependent libs do this too it will mess up the environment nevertheless sooner or later.

@@Linguflex will be amazing when local llms are capable of this. Ive never bothered with openAI for these things, though I am a paid subscriber, aren't the costs in addition to that to use their API? whilst I only have 12GB of vram on my laptop, stuck with the comparatively dumb llms. Though even some of the coqui voice models at time express emotion, the quality of the text they are reading obviously plays a huge role. The thing. I hate about all ai libraries being stuck to specific python versions and package versions...is I must have installed a venv for just about every bloody python version and every bloody py torch version. My love/hate relationship with python.

@@bigdaddy5303 Very true words. It was an insane hazzle to combine all needed libs for linguflex into one single environment. We already have ollama support for linguflex in some implementations on our discord (so I have and another dev but we didnt release it yet). Should be coming soon...

depends (tts license etc), but sure

If you did perform "pip install realtimestt" before then probably your pip/python env is somehow corrupted. You could try it in a virtual env.

@@Linguflex I knew it was something obvious 🤦 Don't know how I missed that step lol Thank you for your help

The interruptions are triggered by the volume level detected on the microphone. It's a straightforward implementation that unfortunately also gets interrupted if the text-to-speech (TTS) output is too loud. To eliminate this issue, implementing echo cancellation is necessary, but that process is quite complex and not trivial

Thank you. We talked about how to do solid interruption in my discord channel recently: discord.gg/f556hqRjpv Highly encourage you to join, it's a great place to ask questions, share progress and get support from tech enthusiasts. Would love to see you there!

Thank you so much for your kind words! ❤ Great to hear that you're learning both Python and JavaScript at the same time in Kenya, I think your determination will definitely pay off. I don't have a specific roadmap since I usually just develop projects based on inspiration and current interests. I highly encourage you to join our Discord community: discord.gg/f556hqRjpv It's a great place to ask questions, share progress and get support from tech enthusiasts. Would love to see you there!

I wouldn't use my realtime libraries for this: they are optimized for speed, not quality. I'd generate a srt file transcript with word-level timestamps with a good STT library like stable_whisper, then add the subtitles to the video using that srt file (ffmpeg can do this for example).

No, currently not. The idea is good, I can see some use-cases for this. I'll think about that.

Can I have it

Sure, here's the repo: github.com/KoljaB/WhoSpeaks

Can be used hands free

This amazing! Is there anyway I could run this on my computer then talk to it using a headset connected to my phone so it’s mobile?

Sure. Could you write your problems as an issue, so others can see how it's solved afterwards? Depending on if it's input or output: github.com/KoljaB/RealtimeSTT/issues github.com/KoljaB/RealtimeTTS/issues

What do you want to do? The "tests" folder contains some examples how you can use it: github.com/KoljaB/RealtimeSTT/tree/master/tests Maybe also the "tests" of RealtimeTTS can help, they also use RealtimeSTT a lot: github.com/KoljaB/RealtimeTTS/tree/master/tests

Thanks a lot for this information, as a dev I'm often just not aware of the problems the users have. I'll rework the Prerequisites section, thx again.

Python

I know basic python, where do I go next?

@@niscchay he literally posted the github page lol

Yes absolutely, we need that. Any ideas where to place it in the UI?

@@Linguflex I know there are quiet few icons already but the simplest would be maybe to add another icon that would open a chat window ?

Not yet but soon

Thx 😀 took me forever to get that soft whisper into the voice, it's included in linguflex btw

Thanks a lot. ❤You can click on the 👂button, then a window opens. At the bottom of that window you can customize the trigger volume for speech interruption. Also you can disable speech interruption completely by adding allow_speech_interruption: false to the listen section of the settings.yaml file (in the Linguflex/lingu folder).

@@Linguflex Thank you ☺️ But I was thinking about to try to build on top of it. Because you might want to only interrupt with certain things, so it doesn’t get interrupted with phrases like “Ahh, I see” or short confirming answers

Right, that's actually a great idea!

@@Linguflex - just thought you would be able to have a more realistic kind of conversation, if it could be able to detect things like that while it’s speaking, so it doesn’t interrupt for everything said.

@@Linguflex - Another thing; is there somehow that I can reach out to you privately? I have a business idea that I have been working on for a while, and I have been following you for quite some time now, and would be interested to pitch an idea for a collaboration, if you are interested?

You probably want to use whisper.cpp with a quantized tiny model and grammar sampling, look up Georgi Gerganov's chess example.

You could also train a wake word model to do this. They are crazy fast and reliable but specialized on few keywords. Check Openwakeword or PvPorcupine.

Thank you. I have a RTX 2080 Super.

@@Linguflex Thanks for your answer! I have some questions. I've seen your email in the comments, can I email you?

You need to install python 3.9.9 first from here www.python.org/downloads/release/python-399/ Another linguflex release is coming soon too (hopefully release in ~2 weeks)

@@Linguflex Already installed that python version, but I'm happy to hear another release is coming! Good luck!

@@MrStellateWaffle Then maybe python was not added to the system's PATH environment variable

@@Linguflex It's a good news, i really like the work you are doing with your various libs.

Elevenlabs or Openai API ran into rate limit. Check characters used in elevenlabs and settings limits in your openai account

@@Linguflex it is saying openai limit crossed. i am using free tier of openai. is free tier enough for this program to run or i must upgrade to paid tier?

Paid account, it needs openai api key.