#3-Deployment Of Huggingface OpenSource LLM Models In AWS Sagemakers With Endpoints

Поделиться
HTML-код
  • Опубликовано: 23 ноя 2024

Комментарии • 42

  • @krishnaik06
    @krishnaik06  6 месяцев назад +4

    Check out the complete p[laylist of GenAI on AWS Cloud Playlist: ruclips.net/video/2maPaQutcWs/видео.html

    • @__john663
      @__john663 6 месяцев назад +1

      Hey krish bro, Is the groq completely free or there is any subscription or hidden charges?

    • @__john663
      @__john663 6 месяцев назад +1

      Hi krish anna
      Can make a video using llama3 8b model with llama-index and chat engine because I need the ai is capable to document retrieval and general interactions. Is this capable to do

    • @KumR
      @KumR 6 месяцев назад

      One request Krish. There is a separate playlist u added 3 months for bedrock. Could you merge those with this playlist too?

  • @intellectfactory
    @intellectfactory 5 месяцев назад +13

    IMPORTANT NOTE : When you create a Domain, user profile and launch any instance, make sure you turn off/pause the instance one you are done with your work. If you don't and just close the browser, the instance will still be running and you will be charged for it if it crosses the free tier limits. I did this mistake and got billed $52 and got to know about it only when I got the bill in my email. Make sure you check the Bills page regularly to see if you are being charged for any running instance.

    • @bornclasher1294
      @bornclasher1294 3 месяца назад +1

      Great information brother. Thank you soo much

    • @viswanathhemanth
      @viswanathhemanth 9 дней назад

      Yes. very important same thing happened to me as well

  • @86tejasd44
    @86tejasd44 2 месяца назад

    It's been a great journey with your amazing lectures ❤❤. Th aka for the sincere work and helping . Sir one request
    Could you please create playlist for entire LLM. And Gen AI combined together
    So that we can easily come to know the continuity

  • @ne8123-g3x
    @ne8123-g3x 8 дней назад

    Hi, great work!
    Can you discuss how to add concurrency and scale it up? for example for deploying a embedding model to embed 100M vectors efficiently.
    Thanks

  • @yogeshmagar452
    @yogeshmagar452 6 месяцев назад +6

    Krish Naik Respect Button❤

  • @Raaj_ML
    @Raaj_ML 2 месяца назад +2

    Sorry Krish...Not sure why you were in a hurry towards the end in explaining that image_uri part...Not clear how is that different from the initial hub image deployment you were explaining..

  • @rsnoor
    @rsnoor Месяц назад

    Sir this is quiet useful and thanks for the step by step explanation. One kind request sir, i think you are shaking your legs continuously and that is shaking your video as well which is distracting, so please either your video even smaller if shaking legs is you mannerism sir.

  • @AshishKumar-sj1ys
    @AshishKumar-sj1ys 6 месяцев назад

    Your tech news video was awsome. please make another ones on regular basics 🎉

  • @torontoTamilan7
    @torontoTamilan7 6 месяцев назад

    Hi Sir , I'm mainly looking for your video on Gemma 7b fine-tuning in sagemaker and deploy as endpoint , it would be highly helpful if you can create a video for this . Step by step . Thanks a lot sir , I'm one of your huge fan . Great work.

  • @classicemmaeasy2292
    @classicemmaeasy2292 6 месяцев назад +1

    Your consistency is contagious ❤💯

  • @AnilKumar-im2ur
    @AnilKumar-im2ur 6 месяцев назад

    Great work!, expecting your next video is to create one session to deploy LLM models using aws ec2 instance.

  • @austinduke8876
    @austinduke8876 2 месяца назад

    Where does the model id come from?
    I looked for it on HuggingFace but I think I missed where that's listed for a given model

  • @__john663
    @__john663 6 месяцев назад +1

    Hi krish anna
    Can make a video using llama3 8b model with llama-index and chat engine because I need the ai is capable to document retrieval and general interactions. Is this capable to do

  • @harshadapatke885
    @harshadapatke885 6 месяцев назад +2

    Thanks for uploading it. One request to you- Can you please make videos on model quantization?

  • @SwethaSelvaraj-br6gi
    @SwethaSelvaraj-br6gi 6 месяцев назад +1

    Can you make a video on serving LLM model BentoML

  • @jefinprince
    @jefinprince 6 месяцев назад

    Can you make a video on creating a bedrock chatbot using langchain and streamlit with multiple knowledge bases and to select a particular knowledge base with a scroll down menu.

  • @ujjalroy1442
    @ujjalroy1442 6 месяцев назад

    Awesome video thanku sir

  • @__john663
    @__john663 6 месяцев назад +1

    Hey krish bro, Is the groq completely free or there is any subscription or hidden charges?

  • @WanderingSatty
    @WanderingSatty 6 месяцев назад +1

    Best moment 16:10 :)

  • @HDSV10
    @HDSV10 6 месяцев назад +1

    Chat Q n A with RUclips video transcript by uploading yt link + multilingual text to speech sir make this project video

  • @Ishaheennabi
    @Ishaheennabi 6 месяцев назад +1

    amazing sir❤

  • @hamidraza1584
    @hamidraza1584 6 месяцев назад

    How to deployment rag model on Amazon. Prepare a video for this

  • @shalabhchaturvedi6290
    @shalabhchaturvedi6290 6 месяцев назад

    Respect!

  • @sheikhobada8305
    @sheikhobada8305 6 месяцев назад +1

    Great👍

  • @viewview6687
    @viewview6687 5 месяцев назад

    Krish, can you tell me what cost it was used for this video if i following as your tutorial pls ?

  • @rishiraj2548
    @rishiraj2548 6 месяцев назад

    👍💯🙏

  • @viewview6687
    @viewview6687 5 месяцев назад

    how much it cost to run code following this video Krish ?

  • @123arskas
    @123arskas 6 месяцев назад

    Love the videos

  • @KrishanKumar-qk9sh
    @KrishanKumar-qk9sh 6 месяцев назад

    How many users it can handle

    • @krishnaik06
      @krishnaik06  6 месяцев назад

      You cN set it to auto scalable

  • @debjeetmukherjee4591
    @debjeetmukherjee4591 Месяц назад

    Is it free
    ..

  • @mohitnemade5320
    @mohitnemade5320 Месяц назад

    Kindly requested please remove subtitle in the video, its getting irritate to watch

  • @AshishKumar-sj1ys
    @AshishKumar-sj1ys 6 месяцев назад

    Where is the first video krish not able to find it 🥲