Llama 3.3 70B in 5 Minutes

Поделиться
HTML-код
  • Опубликовано: 28 янв 2025

Комментарии • 45

  • @duanleksi8512
    @duanleksi8512 Месяц назад +1

    Thanks for mentioning the artificialanalysis, such a comprehensive analysis for choosing the best API and model.

  • @sjkba
    @sjkba Месяц назад +31

    Straight to the point, I like it. What is the environment you are using to get artifacts on an open source model?

  • @jaysonp9426
    @jaysonp9426 Месяц назад +7

    New sub, no bs. Just news. Ty!

  • @qweekorpsqweekorps2726
    @qweekorpsqweekorps2726 Месяц назад +3

    What do you use for screen recording? The quality is amazing!

  • @fontenbleau
    @fontenbleau Месяц назад +2

    Your channel is new to me and was recommended by algorithm. I don't see any reviews of chinese models or really open source ones like Intellect1 first non-corporate one. I see most videos here are corporate commercial marketing stuff.

  • @gabrielnilo6101
    @gabrielnilo6101 26 дней назад

    Is there any place to check how the model behaves while consuming resources from the hardware?
    this is hard to find!

  • @MohamedAfrin0203
    @MohamedAfrin0203 Месяц назад

    how to set the one language in llama3.3-70B?

  • @rafaelpinheiro8378
    @rafaelpinheiro8378 Месяц назад +1

    I FIND THIS TOOL YOU ARE WORKING ON INTERESTING, DO YOU MAKE IT AVAILABLE FOR DOWNLOAD?

  • @cynorsense
    @cynorsense Месяц назад

    Hey can you make a video where we can use OLLAMA on a free GPU on cloud ?

  • @fontenbleau
    @fontenbleau Месяц назад +2

    You can run it easily locally with 128Gb RAM (70B in Q8 usually takes 90Gb), but original Llama is always too censored to the level of "database", there can't be any glimpse of intellect. Chinese already on the same level but censored even weirdly-Qwen 32B decline to instruct Llama installation.

    • @rassular
      @rassular Месяц назад +2

      Llama can be 100% uncensored, you just need the right system prompt.

    • @chidorirasenganz
      @chidorirasenganz День назад

      You can run it locally with 48GB with Private LLM

  • @chris33102003
    @chris33102003 15 дней назад +1

    why the hell is the complete video description and the title in german and the speaker is talking english?

    • @DevelopersDigest
      @DevelopersDigest  15 дней назад

      Google just began trying to auto translate videos - I am not sure if I have control over this. Do others see this?

    • @Svior
      @Svior 12 дней назад

      you can change the audio track to germany if you want, and that's i think the reason why RUclips autotranslate the title to germany (your country i supposed)

  • @girishthegreat
    @girishthegreat Месяц назад +2

    Can run locally on MacBook M4Max 64 GB

    • @404UnknownError
      @404UnknownError Месяц назад

      Not sure but try with something like LM studio or else

  • @GamesGVG
    @GamesGVG Месяц назад +1

    can you tell me how is your mouse movement so clean and smooth?

    • @Dark_Souls_3
      @Dark_Souls_3 Месяц назад +1

      Probably just a low DPI (sensitivity) so he moves his hand a lot to get a little distance

    • @GamesGVG
      @GamesGVG Месяц назад

      @@Dark_Souls_3 looks like screen studio

    • @Svior
      @Svior 12 дней назад

      ​@@GamesGVGits a mac feature from what i know

  • @BrianHallmond
    @BrianHallmond 24 дня назад

    I dont know if I Feel comfortable having anything from Meta installed all over my pc... lol.

  • @Alex-Rusu
    @Alex-Rusu 4 дня назад

    im on all the websites ...and there is absolutly nothing to download ...this is the second video that is telling me is available to download from 3 websites but dosent show you how to do it...absolutly ussles...

    • @DevelopersDigest
      @DevelopersDigest  День назад

      Sorry! LMStudio / Ollama are good options for running these models locally.

  • @poshsims4016
    @poshsims4016 Месяц назад

    Fireworksai & Groq need to add it

  • @chatgpt_onteIegram
    @chatgpt_onteIegram Месяц назад +10

    please drink some water

  • @RebrandSoon0000
    @RebrandSoon0000 Месяц назад

    Great insight on the new model for sure. My GTX 1080 6GB VRAM should be okay with it. What was the name of the app/site you were using to make a mockup react app?

  • @relexelumna5360
    @relexelumna5360 Месяц назад

    Knowledge cut off Dec 2023 is what makes me disappointed. Thought of download but cancel. Meta is filthy rich it can generously give us latest information like Oct 2024 but dont 😢

  • @Z-add
    @Z-add Месяц назад +1

    When is elon releasing his llm model?

  • @reaperdev9857
    @reaperdev9857 Месяц назад +1

    First

  • @realhamza2001
    @realhamza2001 Месяц назад +3

    I know this is unrelated but give the Quran a read, also have a good day :)

    • @icykenny92
      @icykenny92 Месяц назад

      I did 1 / 10. The guy that has within the Quran is a psychopath!

    • @XHackManiacX
      @XHackManiacX Месяц назад +7

      And the bible too. We can always use more atheists :)

    • @bonchitogovindodas3333
      @bonchitogovindodas3333 Месяц назад +5

      ​@@XHackManiacXcompletely unrelated, but the Dune too..

    • @JeremyWinston-f4h
      @JeremyWinston-f4h Месяц назад +1

      @@XHackManiacX lmao, great reply