Видео

You can change the RUclips setting Quality while watching.

Can you be clear?

huggingface.co/blog/fine-tune-wav2vec2-english

@@mlworks thank you so much

That you can get using the requests library.

Good question....idk lol.

Yes.

Which LLM provider are you using?

@@mlworks Using the HuggingFace Pipeline with the same model you used. I did different queries and their responses were in Chinese

@@DKBOsei00 can you share the prompt?

@@mlworks Question: What is South Park? Answer: 表演

github.com/Mayurji/Explore-Libraries/blob/main/LLMs/phoenix-llm-observability-checkpoint.ipynb

Sure

Yes.

Yes, you can use the ada embedding model for generating an embedding vector and store it in a vector store. If you have large documents, you can chunk them based on various chunking techniques that are available in many RAG applications, ensuring the embedding model doesn't truncate your embedding randomly.

how would you do the search? What Tool do you recommend me? Im very new to the topic. Thanks in advance@s

can you tell me about the chunking techniques and the RAG Application? How could I start? :)@@mlworks

@@Z4rnii For chunking, follow this notebook. github.com/FullStackRetrieval-com/RetrievalTutorials/blob/main/5_Levels_Of_Text_Splitting.ipynb

@@Z4rnii Simple RAG - huggingface.co/learn/cookbook/en/rag_zephyr_langchain

page_content_column is the column that represents, the context column of the dataset. Checkout the context column here huggingface.co/datasets/databricks/databricks-dolly-15k What is the task you're going to implement with the dataset? QA I assume

@@mlworks yes a QA, and I'm suppose to use LLM model to make it more interactive and that's when I got confused because when I passed the data my bot is responding Grammatically incorrect sentences

@@rps6949 RAG helps LLMs to provide accurate and precise information based on the knowledge base. Are you using pretrained LLM or a custom LLM which you've got after fine tuning llm for your dataset, that has learnt the mapping between QA. If yes, then you can generate embeddings of your answers & store in vector store and ask the query to the system.

@@rps6949 if you mean interactive as in chatbot, you can set the system prompt for the LLM and this act as conversation agent.

@@mlworks i'm using a pretrained model , as in your code you are using datasets and then huggingface loader to load , what i have to do is ui from where user is uploading a csv file so i used CSVLoader but just like context column i have a text column but i'm not able to provide that column for embedding i just loader data from loader.load(), what i can do here?

I've stopped that in the last few videos.

github.com/Mayurji/Explore-Libraries/tree/main/NLP-Libraries

@@mlworks Thanks!

Check out this playlist if interested ruclips.net/p/PLVVBQldz3m5v1ROxjWevimVl2eG2-asku

You mean the programming language or library?

@@mlworks I meant the IDE

@@theGSJournal Jupyter notebook in VSCode.

@@mlworks thank you !

Noted.