Google's Gemma2 SLM on NVIDIA Jetson Orin Nano: The Future of Conversational Edge AI

Поделиться
HTML-код
  • Опубликовано: 7 ноя 2024

Комментарии • 17

  • @NVIDIADeveloper
    @NVIDIADeveloper  10 дней назад +4

    Curious to learn more? 📚Check out the Google Gemma Dev Day Playlist in the description to explore deeper insights on Gemma2. ruclips.net/p/PLOU2XLYxmsIKOyXflnuPK-qe32hZLc2HB

  • @johnnynuca14
    @johnnynuca14 10 дней назад +3

    top Asier! Keep pushing

  • @lil----lil
    @lil----lil 10 дней назад +4

    Jensen, PLEASE if you gonna charge me 2K for the 5090, it BEST HAVE a Jetson built-in already and MORE! I want local LLM NOW!!

  • @novantha1
    @novantha1 8 дней назад

    The Nvidia Jetson line is super interesting as an idea. The RAM used is a lot cheaper per gigabyte than VRAM so you can get monstrous model sizes for the price, and it’s a lot easier to manage in terms of thermals and power, but the software stack feels quite different to desktop CUDA on x86, and not all projects will work out of the box.
    It does get a bit weird when you try to evaluate a Jetson module against, say, CPU execution on a desktop platform where you have a lot more freedom, or against a Ryzen iGPU where you can actually outperform the Jetson modules in terms of RAM per dollar.
    I think it’d be really interesting to see cheaper Jetson modules on a modern architecture that had native support for clustering with fast networking of some description, though.

  • @efiritamaradeinyefa1510
    @efiritamaradeinyefa1510 9 дней назад

    Really amazing

  • @atanu2531
    @atanu2531 6 дней назад

    Can we get in India ?

  • @smartduck904
    @smartduck904 10 дней назад +3

    I'm having conflicts with DaVinci resolve recently after the latest update to my driver's

  • @mihalamm
    @mihalamm 10 дней назад

    Can you add e.g. an A2000 through that M.2?

  • @fahdabrahams4524
    @fahdabrahams4524 6 дней назад

    Can it reed stock charts?

  • @namesurname6583
    @namesurname6583 10 дней назад +8

    Guys, the Jetson Nano product itself is just gorgeous. but please see what you are delivering as an operating system. It's just terrible. it was made by an amateur. the disk was split incorrectly. it takes a lot of time to make it at least a little usable. It is better to use this time to study programming.

    • @SuchirKavi
      @SuchirKavi 10 дней назад +1

      yup, it’s awful. i can’t imagine anyone using this in production uses much of the default system. though it did get better with jp6 (got rid of those awful “overlays”).

    • @gamekida4007
      @gamekida4007 10 дней назад

      I am also facing the same issue, could you please let me also know or share the resource on how did you solve the issues ? Thanks

    • @johnnynuca14
      @johnnynuca14 10 дней назад +1

      @@SuchirKavi jetpack 7 and jetson thor is coming in 2025. Thor is based on blackwell and jp7 on 24.04

    • @namesurname6583
      @namesurname6583 10 дней назад

      @@gamekida4007 you don't need to do this. let the NVIDIA people do it.

    • @SuchirKavi
      @SuchirKavi 9 дней назад

      ok? “ n+1 is coming out next year”. why do I care?

  • @antonpictures
    @antonpictures 7 дней назад

    That conversation 6:15 is all hallucinations :) It is the wrong way to teach them talk.

  • @RogerSchlafly
    @RogerSchlafly 9 дней назад

    This is not a step-by-step setup, for beginners. The instructions used in the demo are not listed anywhere.