Chat Bot With PyTorch - NLP And Deep Learning - Python Tutorial (Part 1)
HTML-код
- Опубликовано: 3 окт 2024
- In this Python Tutorial we build a simple chatbot using PyTorch and Deep Learning. I will also provide an introduction to some basic Natural Language Processing (NLP) techniques.
1) Theory + NLP concepts (Stemming, Tokenization, bag of words)
2) Create training data
3) PyTorch model and training
4) Save/load model and implement the chat
Resource:
This tutorial was inspired and adapted from the following article:
"Contextual Chatbots with Tensorflow": chatbotsmagazi...
✅ Write cleaner code with Sourcery, instant refactoring suggestions in VS Code & PyCharm: sourcery.ai/?u... *
📚 Get my FREE NumPy Handbook:
www.python-eng...
📓 Notebooks available on Patreon:
/ patrickloeber
⭐ Join Our Discord : / discord
If you enjoyed this video, please subscribe to the channel!
NLTK:
www.nltk.org
You can find the code on GitHub:
github.com/pat...
PyTorch Beginner Course:
• PyTorch Tutorials - Co...
Please checkout my website to see all tutorials:
www.python-eng...
You can find me here:
Twitter: / patloeber
GitHub: github.com/pat...
Icons:
fontawesome.co...
fontawesome.co...
#PyTorch #NLP #DeepLearning
----------------------------------------------------------------------------------------------------------
This is a sponsored or an affiliate link. By clicking on it you will not have any additional costs, instead you will support me and my project. Thank you so much for the support! 🙏
You are the best!! Among all the youtube videos about chabot , you are the only one to explain step by step the fundamentals of coding a chatbot.
glad you like it!
Very clear. Much better than the later tutorials. I understood the meaning of tokenization and bag of words when you demonstrated what happens during the execution of the code.
You can tell the difficult theory to the easy one,you're the master!😁
Such a good explanation, seriously anyone with a negative IQ can also understand!
Never stop uploading please :)
thanks so much!
.👆Friendship often ends in love; but love in friendship
Very informative and explains everything! Please do more videos like this!
I saw many videos but your explanation is great.
Glad to hear that :)
Oh man I love that, I'm working on a chatbot based project and these videos will definitely help me
glad to hear that!
I am really happy to see your efforts. You have done a great job. thanks sir
thanks!
Amazing tutorial, I've no idea about ML or DL, but the video is crisp enough to make understand everything 😊
Glad to hear that!
Waited for months from your last series on pytorch :). Please make videos on NLP with pytorch
yes I finally got around to do some pytorch tutorials! part 2,3, and 4 will be released in the next 3 days. I hope to do even more NLP in the future
you made it much easier for me , great job
Beautiful Explanation bro! just wow!
glad to hear that!
Watched this video... And boom 💥 SUBSCRIBED!!! 😍
yeah thanks a lot :)
Really great!! Keep uploading.
great video man. Really helpful for my course project. Thank you.
Sir, thanks for this video seeing this video has made me love love NLP. I was looking for where to specialise in. Thanks 👍
very clear and easy to understand..thank you for this tutorial :)
Thanks! Glad you like it
It looks like training dataset is same as test set, am I right? Using an AI method to recognize the chat instead of using "if--else" structure.
thank you so much for a wonderful tutorial! by the way, I was curious as to which vscode theme you were using-i find it very nice!
.👆look at the girls
thank you so much for this helpful video! would you consider teaching how to implement a GUI along with it?
Yes good suggestion! I’ll consider it
Nice - thanks for taking the time to make the video
you sound a lot like Kumail Nanjiani. Great video btw
Not at all weeb
Very helpful video and implementation is very clear, Thanks Man
glad you like it!
I like it. Thank you! Is this rule-based or learning-based (retrieval or generative)?
This is a nice video man!, I was hoping if you could do also a chatbot in web? Thank you so much for the effort
Love your playlist on this! Can we use Word2Vec instead of Bag of Words for word embedding?
This is really awesome. After this I want you to develop a machine learning model and deployment using flink kafka hadoop
I will have a look at this...
@@patloeber Please have a look. It will be like a big data archteciture for a bank where each transaction will be monitoried
This tutorial is more german than Germany itself. But great tutorial anyways!
Haha thx
lucky you, you haven't experienced bavarian English xD
Great job, thank you so much
Glad it was helpful!
@@patloeber I would like to ask you for a favor, how may I find Covid19 psychologic Dataset other than Kaggle. Thank you in advance
Nice video, thanks! Just one question: Is this bag of words methode really also how chatbots (as far as I understand also assistants like siri?) with huge amounts of data work. So apple really has millions of tag with possible inputs that can be labelled to one of the tags like "greeting" and so on? Hard to imagine, since it would be such a long way for it to work well :O
I guess they are self learning bots ,they don't have huge data chunks they rather learn as they progress talking with you
no they use much better method like word2vec.
Hey,
Can you build a notification reader(who speaks what's the notification) using python...?
By the way
Your videos are just awesome ❤️
Glad you like it! Will add it to my list
very understandable
Thank you very much for this video.I always search to find this kind of explanations and knowledges.You are really great :)
thanks :)
I am chemist actually .I ve learning python and machine and deep learning and NLP for 3 years.I rarely need to help but sometimes I really need too but there is nobody to ask
I watched all parts and Deployment. I executed also. Amazing work, thank you for sharing 😍. One funny thing I noticed is coffee and tea delivery needs 2-4 days🤣.
What a great video
thank you!
Many Thanks!!
Thanks a lot keep up the good work
Thanks!
Very easy to follow. Very good explanation. Thank you very much.
Can you also show how to do entity extraction in a video or a blog post?
Thank you so much for this great project! I have a slight doubt... In 20:21 part of the video, when we are running the stem function, why doesn't the output show `['organiz', organiz', organiz']` because when you were explaining the concept of stemming you had shown another example where the words universe and university were stemmed as univers and univers repectively
this course is amazing!!! I'm familiar with python, but have no any experience on ML.
any prerequisites for building the chat bot? TensorFlow Tutorial or PyTorch Tutorial both are needed?
genial, gracias por la informacion
Thanks for the instructive content! Can you tell me what editor/ IDE you use with python?
I use VS Code. I have a tutorial about my editor setup on this channel :)
Can I work on this project in jupyter notebook
I am trying to do this code on google colab but facing some issues like how to creat environment or use pytorch there, can you guide me through? also getting errors on tokenizing(sentence)
Please make a chatbot more advance using rnn And other techniques
could u add about how to link database for storing different credentials
14:49
yes before is theory :)
great video !! just one doubt what do i have to specify in data.pth
Will it answer questions regarding Home Remedies?
i know this might not be seen but at 14:10 in the stemming stage why did the 'e' get chopped off form the word 'anyone'?
I believe this is a mistake
What IDE are you using? Great video!
Vs code
Great tutorial! The bot works perfectly fine! Is there any chance you could recommend any german stemmer which works as simply as the PorterStemmer? Really struggling to get this bot to talk german with me....
spacy has german lemmatization support, which is better than stemming anyway. You can also try to skip this part and see if it works without it
Danke für das tolle Video.
Ich habe einen Fehler, würde mich über einen Kommentar freuen
line 134, in _check_not_importing_main
raise RuntimeError('''
RuntimeError:
An attempt has been made to start a new process before the
current process has finished its bootstrapping phase.
This probably means that you are not using fork to start your
child processes and you have forgotten to use the proper idiom
in the main module:
Vermutlich unter Windows, num_workers=0 for the DataLoader, and use if __name__ == "__main__" could be tried to solve this
U r amazing
PS C:\Users\Jane_Brit\Desktop\ProjeTasarimi\ChatBot> conda activate pytorch
Could not find conda environment: pytorch
You can list all discoverable environments with `conda info --envs`.
I'm getting an error like this. Can you help?I'm getting an error like this. Can you help?
The environment is not created so it gives an error that way
hey there great tutorial! i'm having just one problem, when stemming the words when i debug i always get 'None' as a result
I reckon this might be a dump question, but NLTK is that minded for english only?
Great explanation buddy !
Hey, I’m creating a twitter bot that searches for tweets that indicate suicidal tendencies and I want to implement an AI that identifies this kind of tweets.
That’s an awesome application! I have a tutorial where I set up the titter api if you want to have a look at that: ruclips.net/video/yCYPzoG25ak/видео.html
Good video sir, can I use pyttsx3 on this model?
Hi! I'm an early beginner to coding in general. I too am trying to create a chatbot I can use for my website. I just don't know which IDE to use. Which one is Mr. Loeber using in this video?
This is a great explanation!!
I have one doubt...what should you include in your intents file so that the bot responds with some default message every time it does not recognize a sentence asked by the user
I implemented this in part 4. You don't need to put the default message into the intents. You can simply put it in your code and whenever the probability for intent classification is not high enough, you can return the default message
Why not lemmatize vs. stem?
can we get the slides you used for the theoretical parts?
Just a quick question what is the IDLE used in the video? Could I just use pyCharm.
I use VS Code but Pycharm is great, too :)
what good is a chatbot in a terminal?
You are awesome
thanks!
Hey ive seen all your videos for chatbot and even made specifically for my needs, however I just want to ask how do you break into new line in chatbot UI, what to write in intents.json to break in new line in chatbot UI??
is it possible to recive files(upload files) from a bot like pdf and word file?, I found no tutorials teaching that concept
This is really great tutorial, and currently I have a problem about using TF-IDF instead of boW, anyone has any resources to figure it out, please? I will appreciate it!
Do I need to learn pytorch before I learn this??
What kind of algorithm did you use for this entire system? I hope you can reply.
nice
Thanks!
Is it necessary to create a virtual environment
Thanks so much. It was very understandable. But every time I put a new package in python and run it, it still says Module not found error.
What if you misspell a word? Does bow take it as a 0?
Hi all,
i'm getting a error while downloading punkt, i searched everywhere but no answer ,please someone give me a alternative
[nltk_data] Error loading punkt:
Which model of chatbot is being used here in this chatbot and why? Please reply
Hello! can you create a video on how to create a bot on facebook user account not on page using python or js ?
Hey ! Can u add button response in this ?
thnx
Thank you so much for this great project! I have a slight doubt...Every time I import a new package like numpy or random on my VS Code, my system isn't able to read it. It says 'ModuleNotFound' I tried everything from changing to path to reinstalling multiple times but it doesn't work. Please help me out with this. Thank youu
having the exact same problem for installing and importing anything. did you find any general solution?
Hello Patrick, How Can I Stemm in Spanish?
If I wanted to make this bot only respond with questions and never anything other than a question, would it be possible to train it with just the intent file or would I need extra code?
Should work with the intent file
Is this chatbot Rule based chatbot??
May I know Which platform he is using for coding? Please help
Is there a way for a chatbot to answer questions and select responses that have been predetermined through a database we have created? If I saw your video, the chatbot still answers and responds to questions manually according to what is written in the code. I want to make it able to answer and determine its responses online through the database
Can we run this without setting up a virtual environment? If yes, how?
Yes you can, just install it with pip. This will install all packages into your main Python site-packages folder
how can we add voice recognition in the chatbot?
and how and where should I put the code ?
Which editor have you used sir?
For some reason, my print statement is not working. nothing is being printed yet I dont get any error
Great video, But I get an error from testing stemming...... stemmed_words = [stem(w) for w words] ...... The error is invalid syntax Perhaps I forgot a comma? Anyone know whats wrong? Keith
how to integrate this chatbot to our website?
Hey can you tell which ide you are using visual studio code or atom and can you please tell which is better thanks
VS Code!
How to train a model to attach a transformer?
multi-language support?
can it do followups?
Hey wanted to ask what is the use of NLP and pytorch if it answers only particular questions. Can anyone clear my doubt?
Is it retrieval based chatbot?
How do you check the accuracy and model summary in pytorch