Speech AI on Jetson Tutorial

Поделиться
HTML-код
  • Опубликовано: 27 сен 2024

Комментарии • 39

  • @ArztvomDienst
    @ArztvomDienst 7 месяцев назад +7

    THIS is how I want Tutorials to be. No drama, no BS, just boiled down necessary information (and a grain of humor). Instant Sub.

    • @JetsonHacks
      @JetsonHacks  7 месяцев назад +2

      Thank you for the kind words. To be fair, some of the videos only have a sub grain of humor, depending on the allocation for the week. Thanks for watching and subscribing!

  • @InsanityisSanity
    @InsanityisSanity 2 месяца назад +2

    Just ordered an Orin AGX. Cant wait to start learning

    • @JetsonHacks
      @JetsonHacks  2 месяца назад +1

      Congratulations! Lots of exciting work ahead. Thanks for watching!

  • @harry1622
    @harry1622 Месяц назад +1

    First of all thank you for the great video, you helped through my first ai deployment
    I had a laugh seeing mine recognizing your voice testing yours through the speaker

    • @JetsonHacks
      @JetsonHacks  Месяц назад +1

      You are welcome, and thank you for the kind words. That's a great story! Thanks for watching!

  •  Год назад +4

    Pretty straight forward. Thank-you Jim.

    • @JetsonHacks
      @JetsonHacks  Год назад +1

      You are welcome. This took me a couple of months to get it to reliably work, I think it is worth sharing with folks. Thanks for watching!

  • @eranfeit
    @eranfeit Год назад +2

    Hi,
    Just checking . Would it run on the Jetson Nano as well ?
    Eran

    • @JetsonHacks
      @JetsonHacks  Год назад +1

      The RIVA SDK is for JetPack 5 and up. Unfortunately it doesn't run on the Jetson Nano. Thanks for watching!

    • @JetsonHacks
      @JetsonHacks  10 месяцев назад

      You may want to check out Nemo: github.com/dusty-nv/jetson-containers/tree/master/packages/nemo

  • @timothy6537
    @timothy6537 5 месяцев назад +1

    Thanks you!

    • @JetsonHacks
      @JetsonHacks  5 месяцев назад

      You are welcome, and thanks for watching!

  • @seawolfmx
    @seawolfmx 3 месяца назад

    Can you make a video in windows 11? Can you translate tris video to spanish?

    • @JetsonHacks
      @JetsonHacks  3 месяца назад

      I do not know what you are asking. I do not know what 'video in windows 11' means. Unfortunately I don't know Spanish, so you will need to rely on other translation tools.

  • @Luiblonc
    @Luiblonc 6 месяцев назад

    Will this work on the Jetson nano? I am interested on running this on a Jetson nano that I already have, and was wording if I could configure it to work as speech to speech recognition.

    • @JetsonHacks
      @JetsonHacks  6 месяцев назад

      This particular application requires a Jetson Xavier or Jetson Orin to run due to the processing and memory requirements. Thanks for watching!

  • @BenjiNotknown
    @BenjiNotknown Год назад +1

    How could somebody use this method to take the transcribed text then somehow auto translate it into another language? For example, automatically transcribe Russian into English? Is it possible using the available example scripts?

    • @JetsonHacks
      @JetsonHacks  Год назад +1

      The RIVA SDK has a component called Neural Machine Translation (NMT). For example there's English to Russian and Russian to English models to use. Here's a link to the documentation: docs.nvidia.com/deeplearning/riva/user-guide/docs/tutorials-nmt-contents.html
      This is a professional level SDK. 'Example Scripts' may be quite involved depending on what you are trying to do. There is a large amount of sample code.
      Thanks for watching!

  • @Maxwellpaulwall
    @Maxwellpaulwall 10 месяцев назад

    Couple questions:
    1. How much does this cost if you deploy it on your own Jetsin Orin Nano hardware? Is the model free if you deploy it yourself. (I know they charge you if you're using the A100s in the cloud, but what about this?)
    2. When riva is loaded and running, can you seemlessly to speech to text and text to speech without major delays? Or does each module need to be loaded individually (overloading the capacity of this board to run both at the same time, or hugely delay any application relying on both text-to-speech and speech-to-text to occur simultaneously in real time)

    • @JetsonHacks
      @JetsonHacks  10 месяцев назад

      I do not know the answer to your questions. My understanding is that you must pay for RIVA is you meet a certain threshold of use. Please contact NVIDIA for more information. RIVA is in beta on the Jetsons, it's difficult to tell how it will perform in a release form. Thanks for watching!

    • @irem2719
      @irem2719 8 месяцев назад

      @@JetsonHacks is there a fee for using RIVA with Orin? Like if i have nvidia jetson orin do i have to pay for riva ?

    • @JetsonHacks
      @JetsonHacks  8 месяцев назад

      @@irem2719 I do not know the answer to your questions. My understanding is that you must pay for RIVA is you meet a certain threshold of use. Please contact NVIDIA for more information. RIVA is in beta on the Jetsons, it's difficult to tell how it will perform in a release form. Thanks for watching!

  • @SmnHashemi
    @SmnHashemi 8 месяцев назад

    Hi. Thank you for the video. Although I am following all the steps as shown in the video, I am
    getting “Health ready check failed” Error after running the “bash
    riva_start.sh” command.
    I tried with both versions of RIVA 2.12 and RIVA 2.14
    I have NVIDIA Jetson AGX Orin board and nvidia-jetpack version 6.0-b52
    Do you have any idea how should I resolve this?

    • @JetsonHacks
      @JetsonHacks  8 месяцев назад +1

      I do not believe that RIVA supports JetPack 6 yet.

    • @EstebanGallardo
      @EstebanGallardo 4 месяца назад

      @@JetsonHacks Riva 2.15.0 is now supporting JetPack 6. I tried the tutorial but with Riva 2.15.0. but I get the same error: "Health ready check failed". Are we missing something new? I can share any information you need from my side to solve this issue.

    • @QiicKellen
      @QiicKellen 2 месяца назад

      @@EstebanGallardo Hi.Have you solved it? I have the same problem.

  • @yunusozd
    @yunusozd Год назад +1

    is it time to upgrade my TX2?

    • @JetsonHacks
      @JetsonHacks  Год назад +1

      Could be! The Orins are definitely the go forward path for the Jetsons. Thanks for watching!

  • @HSHighScore
    @HSHighScore Год назад +2

    woah, ty to tutorial :D

    • @JetsonHacks
      @JetsonHacks  Год назад +1

      You are welcome, and thanks for watching!

  • @stevephillips5392
    @stevephillips5392 Год назад +1

    Hi, another great video! Do you think I would encounter any problems trying this on a Jetson Orin Nano Devkit running Jetpack 5.1.2?

    • @JetsonHacks
      @JetsonHacks  Год назад

      Thank you for the kind words. Not any issues that I know of, but I haven't tried it yet. Things are always a bit iffy when there are version changes. Thanks for watching!

    • @stevephillips5392
      @stevephillips5392 4 месяца назад

      @@JetsonHacks I did try this on the Jetson Orin Nano earlier with Jetpack 5.1 and failed, but tried it again with Jetpack 6.0 and now everything is working flawlessly. I don't see RIVA support being listed for Jetpack 6.0 but it works. Now to add in a Small Language Model like Sheared-LLaMA-2.7B-ShareGPT.... Thanks again for this excellent tutorial!

    • @JetsonHacks
      @JetsonHacks  4 месяца назад

      @@stevephillips5392 You are welcome. I'm glad you got it to work. Sounds like a fun project!

  • @YigalBZ
    @YigalBZ Год назад

    Great video, thank you. Can Jetson Nano implement the Speech AI and do real time image detection same time? The memory consumption may be a problem....

    • @JetsonHacks
      @JetsonHacks  Год назад +1

      The RIVA SDK does not run on the Jetson Nano, it runs on the Jetson Orin Nano. There are other alternative speech packages for the Jetson Nano. It's hard to tell about a specific application, but lack of memory is going to be an issue on the Jetson Nano. Thanks for watching!

    • @YigalBZ
      @YigalBZ Год назад

      @@JetsonHacksThe video was refering to Jetsons, so was the article without a reference to the Jetson Nano - perhaps that should have been mentioned.

    • @JetsonHacks
      @JetsonHacks  Год назад

      @@YigalBZ Thank you for the suggestion. This is in the video at the 0:40 mark.