Create Chat UI Using ChainLit, LangChain, Ollama & Gemma 🧠

In this video, I am demonstrating how you can create a simple ChatGPT like UI locally in your computer. You can follow along with me by cloning the repo locally. The idea is once you know this approach, you can quickly switch different models.
Open Source in Action 🚀
- Gemma is used as Large Language model.
- LangChain is used as a Framework for LLM
- Gemma model is downloaded locally using Ollama
- Chainlit is used for deploying.
👉🏼 Links:
Chainlit: docs.chainlit.io/get-started/...
LangChain: www.langchain.com/
Ollama: ollama.ai/
💻 GitHub repo for code: github.com/sudarshan-koirala/...
------------------------------------------------------------------------------------------
☕ Buy me a Coffee: ko-fi.com/datasciencebasics
✌️Patreon: / datasciencebasics
------------------------------------------------------------------------------------------
🔗 🎥 Other videos you might find helpful:
🔥 Databricks playlist: • 30 Days Of DataBricks
⛓️ Langflow: • ⛓️ langflow | UI For 🦜...
⛓️ Flowise: • Flowise | UI For 🦜️🔗 L...
🔥Chainlit playlist: • Chainlit
🦜️🔗 LangChain playlist: • LangChain
🦙 LlamaIndex Playlist: • LlamaIndex
------------------------------------------------------------------------------------------
🤝 Connect with me:
📺 RUclips: www.youtube.com/@datascienceb...
👔 LinkedIn: / sudarshan-koirala
🐦 Twitter: / mesudarshan
🔉Medium: / sudarshan-koirala
💼 Consulting: topmate.io/sudarshan_koirala
#langchain #chainlit #ollama #gemma #chatui #chatgpt #datasciencebasics

[@rgm4646]

great video, this works very well!

[@datasciencebasics]

Great to hear!

[@eddieotudor9432]

Great video! Thanks!

[@datasciencebasics]

You’re welcome !!

[@TomanswerAi]

Excellent demo thanks

[@datasciencebasics]

You are welcome!!

[@pavankumarmantha]

Also since you are using everything locally the please try phoenix tracing that’s almost similar to langsmith so with this your entire stack become localised

[@datasciencebasics]

Thanks for the suggestion, will try it !!

[@aimademerich]

Please can you tell us the nav menu on the left of your screen, where can we find that?

[@aimademerich]

Arc browser, found it!

[@datasciencebasics]

Excellent, give a try, its unique and productive tool to use !

[@drmetroyt]

Hi , which is the best 13b and 7b open source model for RAG application which provides answers only from the context provided to it eg : pdf documents uploaded ...

[@datasciencebasics]

It depends upon the model you use.

[@drmetroyt]

@@datasciencebasics i want to know the model which is best for this purpose can you please tell me

[@datasciencebasics]

try mistral or llama2. that’s what I have tried.

[@insta_short_viral]

How can I deploy online?