Deploy (Tiny) LLM to Production: Merge Lora Adapter, Push to HF Hub, Rest API with FastAPI & Docker

Поделиться
HTML-код
  • Опубликовано: 11 сен 2024

Комментарии • 2

  • @venelin_valkov
    @venelin_valkov  6 месяцев назад +3

    Full text tutorial with code (requires MLExpert Pro): www.mlexpert.io/bootcamp/deploy-custom-llm-to-production

  • @surajitchakraborty1903
    @surajitchakraborty1903 6 месяцев назад +2

    Hey, great video. Can the code in the video be shared ?

Следующие
Автовоспроизведение
Local RAG with Llama 3.1 for PDFs | Private Chat with Your Documents using LangChain & Streamlit42:17Local RAG with Llama 3.1 for PDFs | Private Chat with Your Documents using LangChain & Streamlit
Local RAG with Llama 3.1 for PDFs | Private Chat with Your Documents using LangChain & StreamlitVenelin Valkov
Просмотров 9 тыс.
Deploy ML models with FastAPI, Docker, and Heroku | Tutorial18:45Deploy ML models with FastAPI, Docker, and Heroku | Tutorial
Deploy ML models with FastAPI, Docker, and Heroku | TutorialAssemblyAI
Просмотров 95 тыс.
RAG in Production - LangChain & FastAPI11:52RAG in Production - LangChain & FastAPI
RAG in Production - LangChain & FastAPICoding Crash Courses
Просмотров 10 тыс.
A Message from Catherine, The Princess of Wales | September 202403:07A Message from Catherine, The Princess of Wales | September 2024
A Message from Catherine, The Princess of Wales | September 2024The Prince and Princess of Wales
Просмотров 995 тыс.
iPhone 16 Pro Hands-on🔥02:31iPhone 16 Pro Hands-on🔥
iPhone 16 Pro Hands-on🔥Booredatwork.com
Просмотров 341 тыс.
HIGHLIGHTS | ARGENTINA v AUSTRALIA | The Rugby Championship 202405:59HIGHLIGHTS | ARGENTINA v AUSTRALIA | The Rugby Championship 2024
HIGHLIGHTS | ARGENTINA v AUSTRALIA | The Rugby Championship 2024TRC & SUPER RUGBY PACIFIC
Просмотров 737 тыс.
James May finally drives the Tesla Cybertruck14:15James May finally drives the Tesla Cybertruck
James May finally drives the Tesla CybertruckJames May’s Planet Gin
Просмотров 1,2 млн
LLM Function Calling (Tool Use) with Llama 3 | Tool Choice, Argument Mapping, Groq Llama 3 Tool Use27:26LLM Function Calling (Tool Use) with Llama 3 | Tool Choice, Argument Mapping, Groq Llama 3 Tool Use
LLM Function Calling (Tool Use) with Llama 3 | Tool Choice, Argument Mapping, Groq Llama 3 Tool UseVenelin Valkov
Просмотров 2,1 тыс.
How To Connect Your React Frontend To Your AspNetCore Backend23:13How To Connect Your React Frontend To Your AspNetCore Backend
How To Connect Your React Frontend To Your AspNetCore BackendMirco Benthien
Просмотров 175
Build Generative AI Apps with Docker And Hugging Face's Docker Spaces24:57Build Generative AI Apps with Docker And Hugging Face's Docker Spaces
Build Generative AI Apps with Docker And Hugging Face's Docker SpacesKrish Naik
Просмотров 20 тыс.
SQL AI Agents: Analyze Relational Databases with Natural Language using Llama 3 (LLM) and CrewAI19:22SQL AI Agents: Analyze Relational Databases with Natural Language using Llama 3 (LLM) and CrewAI
SQL AI Agents: Analyze Relational Databases with Natural Language using Llama 3 (LLM) and CrewAIVenelin Valkov
Просмотров 4,8 тыс.
Cursor Is Beating VS Code (...by forking it)18:00Cursor Is Beating VS Code (...by forking it)
Cursor Is Beating VS Code (...by forking it)Theo - t3․gg
Просмотров 71 тыс.
LangChain in Production - Monitoring with FastAPI and LangFuse11:23LangChain in Production - Monitoring with FastAPI and LangFuse
LangChain in Production - Monitoring with FastAPI and LangFuseCoding Crash Courses
Просмотров 3 тыс.
Flux-1 (Dev) - Photorealistic Image Generation | LoRA adapter(s), Tutorial on Google Colab17:06Flux-1 (Dev) - Photorealistic Image Generation | LoRA adapter(s), Tutorial on Google Colab
Flux-1 (Dev) - Photorealistic Image Generation | LoRA adapter(s), Tutorial on Google ColabVenelin Valkov
Просмотров 1,8 тыс.
Build Web Scraper with Llama 3.1 | Get Structured Data By Scraping Web Content With AI16:24Build Web Scraper with Llama 3.1 | Get Structured Data By Scraping Web Content With AI
Build Web Scraper with Llama 3.1 | Get Structured Data By Scraping Web Content With AIVenelin Valkov
Просмотров 1,2 тыс.
All You Need To Know About Running LLMs Locally10:30All You Need To Know About Running LLMs Locally
All You Need To Know About Running LLMs Locallybycloud
Просмотров 149 тыс.
How Strong is Tin Foil? 💪00:26How Strong is Tin Foil? 💪
How Strong is Tin Foil? 💪Preston
Просмотров 32 млн
Faites comme moi00:14Faites comme moi
Faites comme moiDaniil le Russe
Просмотров 1,1 млн
美味しい食べ物のASMR _ ASMR FOOD 🍜🍝🍜🥓🥢🍗#asmr #美味しい食べ物#食べ物#vlog00:58美味しい食べ物のASMR _ ASMR FOOD 🍜🍝🍜🥓🥢🍗#asmr #美味しい食べ物#食べ物#vlog
美味しい食べ物のASMR _ ASMR FOOD 🍜🍝🍜🥓🥢🍗#asmr #美味しい食べ物#食べ物#vlogASMR FOOD
Просмотров 1,4 млн
Вопрос Ребром - Булкин59:32Вопрос Ребром - Булкин
Вопрос Ребром - БулкинGazgolder
Просмотров 998 тыс.
«Солнечный» Сергей принял черную технику. Как вам?00:14«Солнечный» Сергей принял черную технику. Как вам?
«Солнечный» Сергей принял черную технику. Как вам?Коллектив Фортуна
Просмотров 61 тыс.
А ВЫ ЛЮБИТЕ ШКОЛУ?? #shorts00:20А ВЫ ЛЮБИТЕ ШКОЛУ?? #shorts
А ВЫ ЛЮБИТЕ ШКОЛУ?? #shortsПаша Осадчий
Просмотров 1,9 млн
My daughter is creative when it comes to eating food #funny #comedy #cute #baby#smart girl00:17My daughter is creative when it comes to eating food #funny #comedy #cute #baby#smart girl
My daughter is creative when it comes to eating food #funny #comedy #cute #baby#smart girlFunny daughter's daily life
Просмотров 8 млн
В ДЕТСТВЕ ДЕЛАЕМ ПАРАШЮТ ИЗ ПАКЕТОВ00:17В ДЕТСТВЕ ДЕЛАЕМ ПАРАШЮТ ИЗ ПАКЕТОВ
В ДЕТСТВЕ ДЕЛАЕМ ПАРАШЮТ ИЗ ПАКЕТОВSIDELNIKOVVV
Просмотров 456 тыс.