Chainlit 🔗🔥 - Build an Arxiv QA Chat Application in Minutes!

Huge props to Michael Wright to highlighting this tool to me!
Learn how to build slick apps and demos with your LLMs using Chainlit, a Python framework similar to Streamlit. In this video, I walk through creating a simple Arxiv QA app with OpenAI's GPT-4 in just a few lines of code. Chainlit lets you:
Build fast - Create apps quickly with minimal code!
This video will show you how to start Chainlit, build an app, and deploy it with Hugging Face. If you're ready to take your LLM experiments to the next level, Chainlit is a fantastic tool to add to your toolkit.
🔗 Hugging Face Space (Paused): huggingface.co/spaces/c-s-ale...
🔗 Chainlit Repository: github.com/Chainlit/chainlit
🔗 Chainlit Docs: docs.chainlit.io/overview
About me:
Follow me on LinkedIn: / csalexiuk
Check out what I'm working on: getox.ai/
#chainlit #llm #generativeai

[@sks_DS]

Hi It does not perform well on follow up questions(related to last question), can you share an implementation where we can include chat history, probably by using memory from langchain. Thanks In Advance.

[@sandorkonya]

Nice one! I just pushed the first colab based notebook (starter) for Chainlit.

[@chrisalexiuk]

Awesome!!!

[@bwilliams060]

Cool, can you provide a link? Would love to see it!

[@paaabl0.]

GPT-4 has builtin plugins, and is served as Api (not to mention by large is still not available to everyone). So what's the fuss about?

[@chrisalexiuk]

I think the major fuss is the turnaround between ideation and a "workable prototype"!

[@bertranddouillard1828]

Hi Chris, thanks for the video, I discovered your channel recently, love it; keep them coming.
One question: I would be interested to understand in more details how the embeddings stored in the vector store are combined with the LLM (GPT4) to produce the final answer. Any chance you could share more info on this?

[@chrisalexiuk]

Basically we use semantic search to find the embeddings that are closest to our query, and then provide the LLM the original text (not the embeddings) as additional context for the LLM!

[@bertranddouillard1828]

@@chrisalexiuk Hi Chris, thanks much for taking the time to answer, I appreciate it.
When you say "semantic search", is that for instance nearest neighbors in embedding space? Or, if not, which technique specifically is used?
And when you say the "original text", "original text" here refers to the text that corresponds to the closest embeddings found?

[@chrisalexiuk]

Great questions!
1. Semantic search here does refer to some NN approach in embedding space. The method you choose is largely preference, though I believe by default ChromaDB uses cosine similarity to extract the most related passages.
2. Original text does indeed refer to the text *pre-embedding*. When the VectorDB is generated, a map between the vectorized text and the plain text is created. This is so we can pass meaningful context to the LLM.

[@bertranddouillard1828]

Got it, thanks Chris for the info.

[@user-wr4yl7tx3w]

Did anyone else get this error when trying to pip install chainlit?
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.

[@chrisalexiuk]

I did not!
Are you on 3.8?

[@GOLUCKY222]

Cool stuff. Do you have any more basic videos for working with VSCode and setting up all the files? I'm interested in a.i but trying to learn some of the foundational stuff first

[@chrisalexiuk]

At FourthBrain, we put this together:
github.com/FourthBrain/software-dev-for-mlops-101
That should help get you a little more familiar with VS Code!
Though for this particular app, you just need to duplicate the space!

[@GOLUCKY222]

@@chrisalexiuk Thanks! I see you recommend wsl for windows users. Is windows itself not a viable environment for ML?

[@chrisalexiuk]

@@GOLUCKY222 I would say that, largely, having a non-Windows environment is preferred. The caveat is that we're often times working on remote machines - in which case your choice of personal OS has little to do with your workflow! If that's the case, Windows is 100% okay!

[@heirofsam]

Do I need to "download" LLM?

[@navneetkrc]

5:51
for creating your own duplicate space

[@user-wr4yl7tx3w]

Can you consider doing another example of Chainlit

[@chrisalexiuk]

What would you like to see?

[@eugenmalatov5470]

​@@chrisalexiuk Yes, please. Maybe use it together with langgraph that is just out.