How To Use Meta Llama3 With Huggingface And Ollama

Поделиться
HTML-код
  • Опубликовано: 23 янв 2025

Комментарии • 67

  • @sanadasaradha8638
    @sanadasaradha8638 9 месяцев назад +32

    Instead of showing all new models it is better to implement a single open source llm for all use cases including fine tuning. At the same time it is better to make an end to end project with opensource llm.

    • @THOSHI-cn6hg
      @THOSHI-cn6hg 9 месяцев назад

      Agreed

    • @devagarwal3250
      @devagarwal3250 9 месяцев назад +7

      There are already same video about showing new model.
      It is better to make a video on how to implement it

    • @KumR
      @KumR 9 месяцев назад +2

      I am with you. New models will keep coming. Focus needs to be on an end to end project

    • @Shubhampalzy
      @Shubhampalzy 8 месяцев назад +1

      how to fine tune ?
      I need some help to build a custom chatbot trained on custom dataset using llama 3.
      Please help

    • @farajacod3717
      @farajacod3717 7 месяцев назад

      @@Shubhampalzy did you find a way to finetune llam3?

  • @nitinjain4519
    @nitinjain4519 9 месяцев назад +1

    When using the Llama3 model, sometimes it gives me an incomplete answer. What can I do to avoid incompleteness when generating responses from the Serverless Inference API?

  • @r21061991
    @r21061991 9 месяцев назад +1

    Hey Krish, It will be more helpful if you can take a session on how to use an offline LLM on a custom dataset for QnA

  • @saharyarmohammadtoosky
    @saharyarmohammadtoosky 6 месяцев назад +1

    Hi Krish, thank you for great knowledge you are sharing, I want to run ollama on aws sagemaker, do you know or have any video regarding doing that, I already saw your video to install and work locally, I do not know how to do on the cloud.

  • @rumingliu9787
    @rumingliu9787 9 месяцев назад +1

    Thanks sir. Very helpful. Just one question, what's the benefit of Ollama compared with hugging face? I guess it is Local deployed but has some basic requirements for your laptop's hardware.

  • @girishkumar862
    @girishkumar862 9 месяцев назад +3

    Hi, there will be 10 billion models coming in future and so on..

  • @mhemanthkmr
    @mhemanthkmr 9 месяцев назад +1

    Hii Krish I too tried the llama3 in ollama response is slow but in your machine the response is fast you are using GPU then what GPU you using ?

    • @shotbotop3790
      @shotbotop3790 9 месяцев назад

      He has a Titan RTX (around 64gp vram) 💀

  • @happyhours.0214
    @happyhours.0214 9 месяцев назад +3

    Sir, please make a llm video on how to train llm models on custom data.

  • @Useryskk9079
    @Useryskk9079 8 часов назад

    Why the same llama is readily available in ollama but it needs permission from hugging face ????

  • @KunalDixitEdukraft
    @KunalDixitEdukraft 9 месяцев назад

    Hi Krish,
    Firstly, thanks to your consistent efforts to keep us updated and learn the latest techs in the realm of Data Science.
    How can I sponsor you on Git Hub and earn a badge?

  • @itzmeakash9695
    @itzmeakash9695 9 месяцев назад

    Hello sir, I have a doubt. Is there any platform to find the latest research papers to read? Also, how can I stay updated about the latest developments in the fields of general AI and AI?

  • @hse13166
    @hse13166 9 месяцев назад

    do we really need ollama to run llama3. when we are able to download/ clone the entire model from HF, do we still need Ollama for running the model? What is the next step after you download the model from HF? how to use it in the Langchain code without Ollama? is that possible?

  • @siddhanthbhattacharyya4206
    @siddhanthbhattacharyya4206 9 месяцев назад

    Krish i wanted to know what would be the pre requisites to follow your langchain series? How much knowledge do i need?

  • @viratsasikishorevarma3535
    @viratsasikishorevarma3535 9 месяцев назад +1

    Hi Krish sir I need a help, please make a video on this basic topic: how ,why to setup virtual environment for python.❤

  • @arpitaingermany
    @arpitaingermany Месяц назад

    what are the two tokens, i can only find the access token which is the other one

  • @ParthivShah
    @ParthivShah 4 месяца назад

    Thank You for this video, krish sir.

  • @KumR
    @KumR 9 месяцев назад

    New models will keep mushrooming every day. I think now videos should focus on more end to end projects using these models. Not just sentiment analysis or language translation or text summarization. Some real life project end to end.

  • @JorgeLopez-gw9xc
    @JorgeLopez-gw9xc 9 месяцев назад

    I have ollama on my computer and I am currently using it to run AI models through Python. I need to correct complex instructions that I can only run with the 70B model, the problem is that due to its complexity it takes a long time to execute (2 minutes), how can I lower the times? Currently the model runs on the CPU, how can I configure ollama to use the GPU?

  • @vysaivicky4724
    @vysaivicky4724 9 месяцев назад

    Sir one doubt how much knowledge of dsa is required in data scientist field please clarify

  • @theyoungitscholar4127
    @theyoungitscholar4127 5 месяцев назад

    Is there a way I can use int8 (select specific quantization) for llama3.1 using ollama

  • @herashak
    @herashak 9 месяцев назад

    When doing Question answering I got an error about logits and LlamaForCausalLM not being compatible, not sure how you got that to work as you said

  • @nishant9847
    @nishant9847 6 месяцев назад

    where will those downloaded model files get saved?

  • @asadurrehman3591
    @asadurrehman3591 8 месяцев назад

    sir plzzzzzzzz tell me about this error.
    RuntimeError: "triu_tril_cuda_template" not implemented for 'BFloat16'

  • @OmSingh-ng3np
    @OmSingh-ng3np 9 месяцев назад +1

    This can be fined tune in the same way right?

    • @Shubhampalzy
      @Shubhampalzy 8 месяцев назад

      how to fine tune ?
      I need some help to build a custom chatbot trained on custom dataset using llama 3.
      Please help

  • @kavururajesh1760
    @kavururajesh1760 9 месяцев назад

    Hi Krish can you please upload a video on Moirai for Time Series LLM Model

  • @janneskleinau6332
    @janneskleinau6332 9 месяцев назад

    Please make a Video on how to finetune LLaMA! I would appreciate it :) Love your videos btw

  • @-MuthuKrishnanJ
    @-MuthuKrishnanJ Месяц назад

    can we use this model to run in CPU locally

  • @cairo8905
    @cairo8905 8 месяцев назад

    Hi
    I have a voice model on Google drive
    but I don't know how to upload it on huggingface
    can you tell me how to upload it?
    or giving you the model link and you upload it if you don't mind 😁

  • @claudiograssi5192
    @claudiograssi5192 9 месяцев назад

    to run locally which gpu do you use?

  • @0f9yxtizitdl
    @0f9yxtizitdl 9 месяцев назад

    Liked your new look, Mr clean.

  • @anaghacasaba9351
    @anaghacasaba9351 7 месяцев назад

    How can we fine tune llama 3 with a pdf?

  • @dhaneshv-tz7qc
    @dhaneshv-tz7qc 7 месяцев назад

    can u make video for llama 3 fine-tuning and API creation

  • @vamsitharunkumarsunku4583
    @vamsitharunkumarsunku4583 8 месяцев назад

    How to download llama3 model in local from NVIDIA NIMS? kindly make a video on it please. Thank you

  • @podunkman2709
    @podunkman2709 8 месяцев назад

    Take look at this demo:
    >>> How many liters of water per minute can a Dutch windmill pump out?
    That's an interesting question!
    The answer depends on the specific design and size of the windmill. However, I can give you some general
    information.
    Traditionally, Dutch windmills are designed to pump water from shallow sources, such as polders or wells, for
    irrigation purposes. The capacity of these windmills varies greatly, but a typical small to medium-sized windmill
    might be able to pump around 0.5 to 2 liters per minute (L/min).
    Some larger industrial-scale windpumps can pump much more, up to 10-20 L/min or even more, depending on the
    turbine design and the pressure head of the water.
    Really? What a sh****

  • @kshitijnishant4968
    @kshitijnishant4968 9 месяцев назад

    my command prompt is raising error saying Ollama not found? any help guys?

    • @krishnaik06
      @krishnaik06  9 месяцев назад

      U need to download and install it

  • @tejas4054
    @tejas4054 9 месяцев назад

    Ye kaam.chatgpt bhi krta hai to ye kyu use kre hum. Llama

  • @ChemFam.
    @ChemFam. 9 месяцев назад

    Sir how and from where we will get the api key

  • @rajsharma-bd3sl
    @rajsharma-bd3sl 7 месяцев назад

    Dude, don't just copy from hugging face and make a video... try to implement these models on some problem like NER

  • @spiritualworld842
    @spiritualworld842 9 месяцев назад

    Sir I'm totally stuck between data field and software field plzz suggest me to overcame from depression 😢😪

    • @tejas4054
      @tejas4054 9 месяцев назад

      Best way don't see youtube its too much overloaded ,,,,,with so much go back to time travel use books read books programming and use pen paper this overload information on youtube is dangerous

  • @Superteastain
    @Superteastain 9 месяцев назад

    This guys good.

  • @danielfischer4079
    @danielfischer4079 9 месяцев назад

    Ollama is downloading really slow for me, any1 else?

  • @tarunmohapatra5734
    @tarunmohapatra5734 9 месяцев назад

    Sir please activate neurolab

  • @deepak4166
    @deepak4166 9 месяцев назад

    What's app meta ai is awesome 🎉

  • @JourneyWithMystics
    @JourneyWithMystics 8 месяцев назад

    Bhaiya how do I convert Hindi video into Hindi text, please 🙏 reply much needed ❤

  • @itxmeJunaid
    @itxmeJunaid 9 месяцев назад

    😮

  • @rishiraj2548
    @rishiraj2548 9 месяцев назад

    🙏🙂

  • @tejas4054
    @tejas4054 9 месяцев назад

    Pair kyu hilaate ho bhai video me

  • @AnkitVerma-62990
    @AnkitVerma-62990 9 месяцев назад

    First Comment 😅

  • @mohsenghafari7652
    @mohsenghafari7652 9 месяцев назад

    tanks krish .
    please answer my email ❤