Deploy LLM App as API Using Langserve Langchain

LangServe helps developers deploy LangChain runnables and chains as a REST API.This library is integrated with FastAPI and uses pydantic for data validation.
github: github.com/kri...
--------------------------------------------------------------------------------------------------
Support me by joining membership so that I can upload these kind of videos
/ @krishnaik06
-----------------------------------------------------------------------------------
►LLM Fine Tuning Playlist: • Steps By Step Tutorial...
►AWS Bedrock Playlist: • Generative AI In AWS-A...
►Llamindex Playlist: • Announcing LlamaIndex ...
►Google Gemini Playlist: • Google Is On Another L...
►Langchain Playlist: • Amazing Langchain Seri...
►Data Science Projects:
• Now you Can Crack Any ...
►Learn In One Tutorials
Statistics in 6 hours: • Complete Statistics Fo...
End To End RAG LLM APP Using LlamaIndex And OpenAI- Indexing And Querying Multiple Pdf's
Machine Learning In 6 Hours: • Complete Machine Learn...
Deep Learning 5 hours : • Deep Learning Indepth ...
►Learn In a Week Playlist
Statistics: • Live Day 1- Introducti...
Machine Learning : • Announcing 7 Days Live...
Deep Learning: • 5 Days Live Deep Learn...
NLP : • Announcing NLP Live co...
---------------------------------------------------------------------------------------------------
My Recording Gear
Laptop: amzn.to/4886inY
Office Desk : amzn.to/48nAWcO
Camera: amzn.to/3vcEIHS
Writing Pad:amzn.to/3OuXq41
Monitor: amzn.to/3vcEIHS
Audio Accessories: amzn.to/48nbgxD
Audio Mic: amzn.to/48nbgxD

[@krishnaik06]

Lot of efforts is required in these kind of videos. Make sure to subscribe,like and share with all your friends :)

[@AmarGuptanwd]

Sir hats off to you for creating these amazing videos and sharing it with us regularly 🫡

[@siliconberry]

as usual, great work sir.

[@xspydazx]

how to use with a local llm ?

[@xspydazx]

dont get it bro ? is this another troute into these online api or are they local ?? how do you use this without chatgpt ?
why do we need to put the openapi-key?

[@mehulpratapsingh8820]

just a simple suggestion do not do all the imports initially import the libraries on the go ,

[@ParthivShah]

Thank You Sir, love from gujarat.

[@palashjyotiborah9888]

Ad at 11:52, you have asked us to mention for any mid-roll ads. Here is one ! thanks.

[@SanjeevyDeveloper]

Krish Naik is literally the Harsha Sai for Machine Learning, Ai and Data Science Stuff. A great Salute for you sir 🙋‍♂

[@geekyprogrammer4831]

Krish Naik is just Krish Naik himself. Dont associate him with other personalities OK.

[@samagrashrivastava8042]

Amazing video, thank you soo much😀😀

[@MahaveerTirumalasetty-b6b]

really loved your explaination is just amazing

[@syedhussain6358]

You are Awesome Bhai. Mashallah.

[@AasherKamal]

Sir how to deploy Open source LLMs and use them as API? (Free)

[@andaiai]

use anything llm

[@dereckjos3513]

This video is amazing but here we are having dependency on openAI is there any way to deploy custom llm models as an api and eliminate dependency of openAI

[@shashankshekhar8970]

Hey thanks for the video. One question: So what benefit exactly does Langserve provide? I could have created a flask end point and inside that just accepted the message and called Langchain LLM with that message. So what is exactly the benefit of using langserve over vanilla fast/flask?

[@krishnaik06]

More coding will be required in flask

[@hamidraza1584]

Like and love from Lahore Pakistan

[@MrSajjadathar]

Thank you so much krish, there is one request can you make a detailed video on crew AI and autogen AI, please

[@Dancekeparwane]

Make an video on cloud computing & which cloud mostly used by mnc

[@braydenfulken2495]

You just got a new sub!

[@devloper.hs14]

Recently you doing a lot of videos on langchain, cool
The only problem i face is not having access to open ai apis. Minor so I can't buy it, and parents think I am doing trash things instead of studying.
Can you provide some altermatives

[@ds341yup]

Thank you Sir.

[@taazkareem]

Hey, what are some prerequisites to learning this? When you say “Deploy LLM App” you’re not actually building the app in Langserve right?

[@TsioritianaRyanRakotoahijohn]

Hello Krish Naik, I really like your videos tutorials about langchain, langserve. But actually, I really want to ask you if you could make a video tutorial about langchain, langserve to make an application like askyourpdf that allowed users to upload their own file.

[@brijeshkp2000]

Great content

[@compsae]

Its a very informative video but can we deploy these API with help of streamlit or something else ?

[@ChanduAki-ht5xv]

Hi Krish,
Can you pleaadd the usecases of lang graph and practical applications in industry

[@agahyucel4502]

Hello @krishnaik06. Do you plan to make the Gemini Pro Fine Tuning video that has been recently published by Google?

[@GregoryPereira-mi2jy]

Make sure you rotate those keys

[@abhishekhingmire8972]

🎉😊

[@cricketalwys]

What is the type of these apis, is there any way to create post method apis?? Like we could define routes and then whether the function will be of get or post type - something like this??

[@ChethanYadav]

LEGIT I WANTED IT

[@andaiai]

after using openai api, making another api end point ?, most of these tricks never serve the production setup scenarios

[@RishiRajxtrim]

Good day greetings

[@Shahbazpucit]

Love from 🇵🇰

[@akshatkant1423]

How to do the same thing for an OSS llm model, lets say a mistral? can i do the exact thing with mistral and how?

[@praneethreddy8722]

You are cool

[@buzzprime93]

Deploy??

[@ShreyashMukte]

What if we need streaming response?

[@nischitkr3269]

Using gradio also I can create api right ?

[@tirthvora8591]

overrated. not a good example of using langserve. This can be achieved using Flask too.

[@AIWalaBro-Bharatbhushan]

I tried hard but giving the 404 error, can anyone help me out into this to resolve