I am always grateful to you. You are the my only teacher who teaches me basics of data science properly. Now with this LLM. langchain. You have superpower to explain everything in very easy way for a dumb student like me. I couldn't be a data scientist and fulfill my dream if you weren't there. Thanks for everything, please do continue this kinda projects for each domain🙏🙏🙏🙏💝💝💝
Did you tried this Rockybot I am facing one error please help me to solve it list index out of range index = faiss.IndexFlatL2(len(embeddings[0])) @@shaonsikder556
Best thing I love about this guy is, he let the audience feel the problem, so that when he is doing this he will be clear that I am solving this problem this should be the approach, love u man for all the content u make
Found a lot of stuff on Langchain on RUclips. But no one went this deep with individual langchain concepts as you did. A lot of confusing topics got cleared today. THANKS FOR THIS. ❤
Amazing video Dhaval!!! Do you have MLOps playlist please share, if not could you please think about creating it using mlflow or zenml because i like the way you teach. Thanks!
The Best best best video on langchain+llm in youtube Thank you sir for wonderful content. Please upload the videos on how to finetune our own data and some more real world usecases like this video .............😇😇😇😇
If anyone is facing list index out of range error then here is an open github issue: github.com/langchain-ai/chat-langchain/issues/68 Using a different version of langchain may help.
i am constantly getting following error at the end: ValueError: The de-serialization relies loading a pickle file. Pickle files can be modified to deliver a malicious payload that results in execution of arbitrary code on your machine.You will need to set `allow_dangerous_deserialization` to `True` to enable deserialization. If you do this, make sure that you trust the source of the data. For example, if you are loading a file that you created, and no that no one else has modified the file, then this is safe to do. Do not set this to `True` if you are loading a file from an untrusted source (e.g., some random site on the internet.).
hello sir the content is awesome and I will recommend it to my friends for sure.If possible it would be still more helpful if you can explain the conversion of table data into the contextual data in further vedio.
When I tried to run this project I'm getting below error: ModuleNotFoundError: No module named 'altair.vegalite.v4' when I run the 'streamlit run main.py' command. I tried different versions which is suggested by GPT and also tried stack overflow. But not resolved issue. I appreciate your help.
hi, for classification use cases do you suggest traditional (SVM, Bayes) Vs RAG /LLM approach.I am new and trying to understand the right use case and match right approach to solve,
@@codebasicsI have used this technique with open source llm and completed a project of chat with local pdf files. For a lack of resources I can't able to build UI for that.i already posted this project documentation in my LinkedIn profile.
I am a beginner to this langchain, LLM world. Just wanted to understand in this example how is the PROMPT to the LLM being created - is it automatic? we are providing the query in the form of streamlit UI input & context in the form of retrieved chunks from vector DB this I understood.
Hi,thanks for this wonderful video.Whne i was implementing LangChain's UnStructuredURLLoader,i am getting libmagic is unavailable and python version==3.10.
Lets assume there is a cron job resding the urls. After a few days will the vector database has huge size? I have requirement where i want to read some documents(PDFs/docx) and get same data from each of it, answer a few questions. Do i need a vector db here? If so doesn't the size grow?
while using unstrcutured URL loader i am facing nltk issue which says punkt tab is not found in the directory i have checked it is present but still same issue
Hi Dhaval - do you think streamlit has a future potential to implement a quick dashboard app at corporate level and get rid of tedious frontend coding ?
Is it possible to "replace" the urls with github repositories of code or documentation? I'd also be important to keep the source metadata just like in this urls example to understand from which document inside which repo the answer came from. Thank you very much!
Sir this is really superb!! Can u plz generate high end machine learning real life projects with data cleaning preprocessing and modelling and end it with a web application.......it would be a very great help as being a student...
@@aishu2623 data cleansing is subject yo project. His data cleansing will most probably be different to your project esp if you are customising it. Otherwise if you are just copying and pasting then it is a different matter. Best of luck
which python version should be used to run this project. Not all the dependencies are getting installed with the latest version of python which is 3.12
Can anyone please suggest me from where Will I get free api key. And how to use it in the .env file? My project is ready but question answer is not working. Please help me with this
When loading the pkl file, I keep getting "ModuleNotFoundError: No module named 'langchain.schema.document'" error. I am using python 3.11.1 on Macbook Air. Thanks!
Hey can you check if it is this issue? github.com/langchain-ai/chat-langchain/issues/68 One way could be to use the same langchain version that I am using 0.0.284 Please install the same version of libraries as specified in requirements.py
hello sir, I was confused how can i create selenium test cases of a web application using langchain can i directly import the selenium documentation and expect the ai to create the test case(for example: a button functionality).
can you suggest an open source embedding instead of openAI embedding, that works fine for this project? I used bert and glove, and received nothing but endless errors
Check out our premium machine learning course with 2 Industry projects: codebasics.io/courses/machine-learning-for-data-science-beginners-to-advanced
I am always grateful to you. You are the my only teacher who teaches me basics of data science properly. Now with this LLM. langchain. You have superpower to explain everything in very easy way for a dumb student like me. I couldn't be a data scientist and fulfill my dream if you weren't there. Thanks for everything, please do continue this kinda projects for each domain🙏🙏🙏🙏💝💝💝
Did you tried this Rockybot
I am facing one error please help me to solve it
list index out of range
index = faiss.IndexFlatL2(len(embeddings[0]))
@@shaonsikder556
please resolve the index 0 issue
can I use Gemini API key instead of Open AI?
How model will work when 5 different users are providing different url to model simultaneously?
I like the way you explain the business scenario and toolset required to implement the solution in the PoC and Production phases.
Best thing I love about this guy is, he let the audience feel the problem, so that when he is doing this he will be clear that I am solving this problem this should be the approach, love u man for all the content u make
This is the best tutorial I have watched on LLM. Crisp, yet detailed. Thank you!
An end to end langchain project cannot be more clearer and perfect than this one !
Found a lot of stuff on Langchain on RUclips. But no one went this deep with individual langchain concepts as you did. A lot of confusing topics got cleared today. THANKS FOR THIS. ❤
Glad you enjoyed it!
sir please help me to solve this error
list index out of range
index = faiss.IndexFlatL2(len(embeddings[0]))@@codebasics
One of the best courses on RUclips to learn GenAI. Thanks a lot for this
It's just a perfect combination of depth and width!! Thank you so much!!
what version of lang chain are you using ?
Thank you so much for this wonderful tutorial, really helps me in implementing a POC in my company
Thank you sir for this wonderful tutorial, which made me understand about the end to end LLM project in a simple way. Great work.
Thanks a lot, I'm so happy that I came accross this video. Best tutorial.
you are awesome teacher, I rarely post comments below yt movies.. you just have explained it in very easy and understable way.. ;-) well done
This is the best tutorial i have watched till date, kudos for the effort to put in to make this video.
Coding... Coding... Coding... I don't like it! I avoid! But! Coding likes me! I can't avoid!
🤣🤣😜
😂😂
@@codebasics is this has RAG implementation
Another excellent learning video! You explained the end-to-end LangChain application workflow very nicely. Thanks!
Your tutorials are amazing and these are really helpful
Absolute best explanations. To class. Thank you.
what more simple explanation could be possible than this. Awesome explanation and project concept.
dude i just started and loved the rocky bhai story HAHAHAHAHAHA
Accept my gratitude all the way from Pakistan ❤️
🙏🏼
I'm getting bugs over here. How did you get passed the index out of range?
Excellent video. Very well explained. Thank you so much!
Amazing video Dhaval!!! Do you have MLOps playlist please share, if not could you please think about creating it using mlflow or zenml because i like the way you teach. Thanks!
The Best best best video on langchain+llm in youtube Thank you sir for wonderful content.
Please upload the videos on how to finetune our own data and some more real world usecases like this video .............😇😇😇😇
Getting an error:
module 'magic' has no attribute 'from_buffer'
tried multiple fixes, but unable to resolve.
Hi, Thanks for such an amazing session that made me very comfortable with langchain
Thank you! your trainings were always great and this one is even greater!
such a nice explanation sir. well understood. got an idea for my project work ,thank you sir .
this is a movie or theory well explained and a powerful content thanks for this need more...
i was working on a langchain project myself! perfect timing!
Thanks this explains the concepts really well and brings them to life.
Thanks sir theory is completed ,now I have to implement
If anyone is facing list index out of range error then here is an open github issue: github.com/langchain-ai/chat-langchain/issues/68
Using a different version of langchain may help.
I tried 3 different versions but it did not work, on which version it might work?
The best one so far! Amazing
super useful thank you so much. you are great tutor expecting more videos like this
thank you so much sir. The project and explanation were very helpful
Literally had this same project last month in my organisation
Nice eee jumping in this weekend thank you
i am constantly getting following error at the end: ValueError: The de-serialization relies loading a pickle file. Pickle files can be modified to deliver a malicious payload that results in execution of arbitrary code on your machine.You will need to set `allow_dangerous_deserialization` to `True` to enable deserialization. If you do this, make sure that you trust the source of the data. For example, if you are loading a file that you created, and no that no one else has modified the file, then this is safe to do. Do not set this to `True` if you are loading a file from an untrusted source (e.g., some random site on the internet.).
The intro is just lit
I am currently doing this project and it shows error that you exceeded your quotation limit
@codebasics sir when i am running this model in my localhost after spillting step it is showing index out of range
hello sir the content is awesome and I will recommend it to my friends for sure.If possible it would be still more helpful if you can explain the conversion of table data into the contextual data in further vedio.
Should have invested in Nvidia 5 months before to double the amount, Bro give the best financial advice 😜
happy to see Rocky bhai reference :)
Amazing videos in the playlist! Thank you for your hard work!
Thank you. I have a question why not use a news API to retrieve article and company topics that individual urls?
When I tried to run this project I'm getting below error:
ModuleNotFoundError: No module named 'altair.vegalite.v4' when I run the 'streamlit run main.py' command.
I tried different versions which is suggested by GPT and also tried stack overflow. But not resolved issue. I appreciate your help.
Rocky bhai made me watch the whole video😂 good job
This was an awesome overview! Thank you for all the work put into it!😍
Glad you enjoyed it Lisa!
hi, for classification use cases do you suggest traditional (SVM, Bayes) Vs RAG /LLM approach.I am new and trying to understand the right use case and match right approach to solve,
Please do a video on LlanGraph...you will do it better than others for sure.
To learn llm what is prerequisites... please clearly mention
Is machine learning /deep learning required? @codebasics
Thank you so much Dhruw for this wonderful explanation :)
Awesome project tutorial. Thank you. Learned a lot and will use in my projects. 🙏🙏🙏🙏
Glad it was helpful!
sir please help me to solve this error
list index out of range
index = faiss.IndexFlatL2(len(embeddings[0]))@@codebasics
sir please help me to solve this error
index = faiss.IndexFlatL2(len(embeddings[0]))
@@codebasicsI have used this technique with open source llm and completed a project of chat with local pdf files. For a lack of resources I can't able to build UI for that.i already posted this project documentation in my LinkedIn profile.
can we use other llms other than open ai - if so how
- also can you show how this is done on sagemaker
I am a beginner to this langchain, LLM world. Just wanted to understand in this example how is the PROMPT to the LLM being created - is it automatic? we are providing the query in the form of streamlit UI input & context in the form of retrieved chunks from vector DB this I understood.
Nice work sir... It's clear understanding... 🎉🎉😊😊😊
Very good tutorial.Thanks for all the effort.
This is the biggest challenge of AI - 99% of the AI RUclips stars are inventing something which has already been solved 15 yrs back.
Woow..my new hero Peter Pandey
Amazing! Big Thank You Sir.
why did you not do Vector Embedding in the project? You did it in the Interstellar Text.
Hi,thanks for this wonderful video.Whne i was implementing LangChain's UnStructuredURLLoader,i am getting libmagic is unavailable and python version==3.10.
great video! could you please do a video on how to set up our jupyter environment?
Waiting for this series!!
Thank you
we can just provide the web link to gpt-4 and ask questions right? how is this any different from that?
Hello, Thank you for the video. I have a Question. Is there a technical way to measure the validity of responses?
AMAZING WORK DONE, SIR I REALLY APPRECIATE YOUR EFFORTS!
Is OpenAi free?
Great Explaination Thank you so much !
Lets assume there is a cron job resding the urls. After a few days will the vector database has huge size? I have requirement where i want to read some documents(PDFs/docx) and get same data from each of it, answer a few questions. Do i need a vector db here? If so doesn't the size grow?
while using unstrcutured URL loader i am facing nltk issue which says punkt tab is not found in the directory i have checked it is present but still same issue
Same problem
Did you find solution ??
One question here
How are we fetching the required chunks as per the prompt given? Can you please throw some link or suggest how this we can tackle?
Hi Dhaval - do you think streamlit has a future potential to implement a quick dashboard app at corporate level and get rid of tedious frontend coding ?
no
i want to deploy this project but lack of secret key, i can't do,
Is it possible to "replace" the urls with github repositories of code or documentation? I'd also be important to keep the source metadata just like in this urls example to understand from which document inside which repo the answer came from. Thank you very much!
we can build it together
thank you very much 😍. Can you post the slide, it's very helpful
Is there an advanced course video for industry professionals which can teach how to build such applications for real time company use case?
Why didnt we use SentenceTransformer and FAISS in the final project ?
Just a thought is or unniverse is quantified .
If we want to make a simulation what tokens numberwould be the max.
Sir this is really superb!! Can u plz generate high end machine learning real life projects with data cleaning preprocessing and modelling and end it with a web application.......it would be a very great help as being a student...
I think he has done it already. Potatoe disease project.
@@alphar85 that comes under Deep learning for my 5th sem project I have done that
@@alphar85 and moreover no data cleaning process is involved in potato disease classification. And plz respect it is sir not him.
Thank u
@@aishu2623 ok sorry i thought you just wanted an end to end project.
@@aishu2623 data cleansing is subject yo project. His data cleansing will most probably be different to your project esp if you are customising it. Otherwise if you are just copying and pasting then it is a different matter. Best of luck
Thanks for this nice tutorial !
Rocky boi hehe
Thanks a lot, Could you please create LLM builder on structured data.
which python version should be used to run this project. Not all the dependencies are getting installed with the latest version of python which is 3.12
Thank you very much. its great.
Thank you!. very much useful.
Can we use scrapping and automation libraries like Selenium and beautifulsoup for long term project???
what if i put other url links will i get the insights ......and is it made only for finance
I am getting this error
cannot pickle '_thread.RLock' object
Please tell a fix for this. And also this video is a gem.
Can anyone please suggest me from where Will I get free api key. And how to use it in the .env file?
My project is ready but question answer is not working. Please help me with this
For me also the same did you resolve it
When loading the pkl file, I keep getting "ModuleNotFoundError: No module named 'langchain.schema.document'" error. I am using python 3.11.1 on Macbook Air. Thanks!
anyone please tell me why we put three URLs and can i put only one if i need?
is there any key metrics to check the performance of llm ?????
Great video Dhaval👍
Can an MBA finance student do this project? If she is looking for financial analyst job?
Wonderful content. Super useful. Thanks a lot!. I am getting "list index out of range" error on "FAISS.from_documents(docs, embeddings)". Any idea?
Same. Did you find any solution?
Hey can you check if it is this issue? github.com/langchain-ai/chat-langchain/issues/68
One way could be to use the same langchain version that I am using 0.0.284 Please install the same version of libraries as specified in requirements.py
Not Able to solve the issue sir .....please provide the correct solution to solve the error@@codebasics
@@chinnibngrm272did u find a solution bro?
@@chinnibngrm272 were ypu able to solve that error?
hello sir,
I was confused how can i create selenium test cases of a web application using langchain
can i directly import the selenium documentation and expect the ai to create the test case(for example: a button functionality).
Great helped a lot. But if i want a source link of the document which i have in my knowledge base (vector database) how would i be able to do that?
can you suggest an open source embedding instead of openAI embedding, that works fine for this project?
I used bert and glove, and received nothing but endless errors
What are pre requisites, I have done python and library like numpy and pandas can I do this or I need to learn some thing first