CONTROL your Personal AI Assistant with GPT-4o mini & ElevenLabs (AI TTS & STT)

Поделиться
HTML-код
  • Опубликовано: 23 дек 2024

Комментарии • 38

  • @jorgeconsulting
    @jorgeconsulting 4 месяца назад +5

    Your content is top notch man. It’s really easy to digest.

  • @lakergreat1
    @lakergreat1 4 месяца назад +6

    the #1 video I look forward to each week, sent you an email as well

  • @WeeklyTubeShow2
    @WeeklyTubeShow2 4 месяца назад +8

    That first one may as well have called you senpai. 😂

  • @thetagang6854
    @thetagang6854 4 месяца назад +2

    Amazing, so much value in a PA. Can't wait for speech-to-speech models to come to the market, super natural convos.

  • @christyson4245
    @christyson4245 4 месяца назад +1

    As we say in the UK - this is the dogs bollox! Fantastic work as always Dan.

  • @ew3995
    @ew3995 4 месяца назад +6

    would it be possible to further reduce latencies by streaming transcription and streaming response

  • @ronisaroniemi8501
    @ronisaroniemi8501 4 месяца назад

    Amazing content - keep up this combo of practical + high level videos 💪

  • @brianmorin5547
    @brianmorin5547 4 месяца назад +2

    Same thing I’ve been playing with these week. I want to carve out some time to take chunks from the streaming to create a loop of sending and receiving from the TTS API for super low latency
    I think the biggest problem is maintaining continuity of the voice so perhaps render the first sentence locally and while it plays assemble the next audio file or two server-side then send back?????

  • @6lack5ushi
    @6lack5ushi 4 месяца назад +10

    you can get faster calls using Groq new LARGE whisper, and Llama 3.1 70bn if you stream the audio ASAP and have tiny chunk sizes you can down to sub 1 second responses

    • @zipaJopa
      @zipaJopa 4 месяца назад

      Do you have any repos on hand that showcases this setup?
      Many thanks!

    • @6lack5ushi
      @6lack5ushi 4 месяца назад

      @@zipaJopa I can dig one up and put it on git gimme a few hours, I have an iOS version but it’s faffy. Will reduce it to python and write a simple readme

    • @6lack5ushi
      @6lack5ushi 4 месяца назад +6

      ​@@zipaJopa Just rewrote the script will post it to GIT in a few mins and share the link here. (y) might make a video on it actually... Thanks for asking

    • @zipaJopa
      @zipaJopa 4 месяца назад

      @@6lack5ushi my hero! 💕

    • @pajarobobo4467
      @pajarobobo4467 4 месяца назад

      @@6lack5ushiwheres the link?

  • @ytubeanon
    @ytubeanon 4 месяца назад

    that's neat, I've been trying to get TTS to work for open-interpreter which I use a lot with gpt-4o-mini

  • @seventhapex
    @seventhapex 4 месяца назад +2

    do you know what the word "own" means?

  • @ModernCentrist
    @ModernCentrist 4 месяца назад

    What would be the main difference between the custom voice assistant and the OpenAI voice mode?

  • @TimothyJoh
    @TimothyJoh 4 месяца назад

    This was so great. I left you a PR on the repo, waiting for your feedback. Would love to demo it for you.

  • @YorkyPoo_UAV
    @YorkyPoo_UAV 4 месяца назад

    Is there a way to run this on your mobile device and have it in a call/open conversation function?

  • @yuniorgonzalez4638
    @yuniorgonzalez4638 4 месяца назад

    Amazing job !!!

  • @ariramkilowan8051
    @ariramkilowan8051 4 месяца назад

    Love the content but I think it would be helpful to at least mention relative costs. You've said in the past that the API costs are worth the investment. You are likely correct but probably still worth mentioning. Thanks again for the content.

  • @andrewandreas5795
    @andrewandreas5795 4 месяца назад

    Does anybody know a STT model that could be run locally for live transcript?

  • @mrd6869
    @mrd6869 4 месяца назад +1

    The top area for this will be Cybersecurity hands down.
    In years time there will be entire cyberwars being waged and run by AI systems.

  • @Mosen_xd
    @Mosen_xd 3 месяца назад

    perfect

  • @EternalKernel
    @EternalKernel 4 месяца назад +3

    Eleven labs pricing structure is prohibitive. Very prohibitive.

  • @BaldyMacbeard
    @BaldyMacbeard 4 месяца назад +3

    "Personal AI is TOO valuable to leave in the hands of Big Tech"... proceeds to build his AI assistant with APIs hosted by "big tech". Kinda expected to see whisper, llama, mycroft or sth.

  • @littledovecitydust
    @littledovecitydust 4 месяца назад

    this is just a voiceflow type chatbot, it's not your own assistant.

    • @orthodox_gentleman
      @orthodox_gentleman 3 месяца назад

      Good point. I don’t really understand the point of this.

  • @itskittyme
    @itskittyme 4 месяца назад

    cringe lol