Not sure why everyone commenting negative on narrator. Installation on windows is difficult for privateGPT. I tried and got many errors. This video he explained clearly what errors we may get and how to resolve them. He even uninstalled chocolaty and reinstalled for us to understand how to do that. I like funny narration. Don't know why people can't appreciate genuine efforts.
@@Tubby-oq3uu I like the video very much and the audio is great and inspiring. Can a chatbot be installed on the Python 🐍 console 🖥 of a program like Paraview? Paraview is a software to display 3D models and it contains a Python 🐍 console to run scripts for repetitive tasks.
Awesome tutorial grandpa... After going through number of tutorials I was literally going to give up but you saved me ... Now I have a place to come if nothing works... 😊
thank you so much. i tried via other tutorials but this is the only that worked so far. installing this is not an easy task as all the steps are scattered all over the internet but you made it easier.
Simply liking the video wasn't enough. I had to post a comment and also subscribe. Thank you for showing the errors and how to mitigate them. Other tutorials will skip the error side of the work to show how professional they are and ordinary people will encounter to errors. The process is not as fluid as they show. But you made my problems go away. THANK YOU
Thank you so much for your kind words! I'm glad the troubleshooting section was helpful. It's important to me to show the real process, including the challenges.
I was looking for this type of service to process my text locally since centuries, and after I succeeded in the installation and running the program I was so so happy that I came and hit subscribe again and again and again ..... forgot that I am already subscribed 🤣 .... RUclips should put this video on the front page! People, including myself, suffered a lot and couldn't figure out how to setup the latest privateGPTon windows due to many complexities involving the process. Thank you soooooooooooooooooooooooo much! Well, you know what, I might just download this video, its a treasure!
Crazy voice, but your tutorial seems the only one on internet to work correctly and no need additional jobs to search installation options except for downloading anaconda from beginning. Thank you very much! Maybe you know, can I enable AMD support vith vram512mb?
Thank you for the kind words! Regarding AMD support, it can be tricky. You might need to use a CPU-only version or explore alternatives like WSL2 on Windows.
What happens if you ask it to "create a windows installer for privategpt". Going through all of the rigamarole to install it when it is unclear how the end-product will perform is enough to make me skip it. Just saying..
😂 so true. Creating a Windows installer for PrivateGPT would be a complex task due to its dependencies. For now, I recommend following the manual installation process to ensure proper setup and compatibility.
i sympathize with ur video but it didnt work for me i still get an error after using the prompt from the github user. it might be cuz i have an amd gpu on windows? idk
I'm sorry to hear you're still encountering errors. AMD GPUs on Windows can be tricky with some AI projects. Consider trying a CPU-only setup or exploring alternatives like WSL2 for better compatibility.
Regarding language models, check the config.yaml file in the project root for model settings. As for external queries, PrivateGPT typically runs as a local server. Check the project documentation for API endpoints if available.
@@bradcasper4823 Try running "poetry run pip install tomlkit" within your project environment. If that doesn't work, ensure you're using the latest version of Poetry and that your environment is activated.
Visual Studio isn't always required, but the C++ build tools it provides are often necessary. You can try installing just the build tools if you prefer.
when I run, poetry run python scripts/setup I now get this error "None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used. Traceback (most recent call last): File "D:\Windows\LLM\privateGPT\scripts\setup", line 8, in from private_gpt.paths import models_path, models_cache_path ModuleNotFoundError: No module named 'private_gpt'" Even after installing torch, I get this error that "no module named private_gpt"
Thank you. Worked for me too, after some adjustmens. Could you make a video how to choose a model from hugging face and what the criterias could be for choosing a model. Nothing there yet, on youtube.
Some latency is normal, especially during the first run or with larger models. Performance can vary based on your hardware and the specific model being used.
privategpt is insane if it thinks im going to install conda, poetry, mingw, and all this total bs on my computer! if you really need all this crap, it's time to make it docker compatible, and just have an image.
I understand your frustration. While these dependencies are necessary for the current setup, a Docker image could indeed simplify the process. I'll pass along the suggestion to the PrivateGPT developers.
Building wheels can be tricky. Make sure you have the latest C++ build tools installed. If issues persist, try using a pre-built wheel or consider using a CPU-only version. Also, recently when I did an install using a pre-built wheel for llama-cpp-python, I installed the CUDA toolkit of the matching version. For example, try this with CUDA 12.1 installed: pip install --no-cache-dir --force-reinstall llama-cpp-python --extra-index-url abetlen.github.io/llama-cpp-python/whl/cu121 numpy==1.25.2
I understand your frustration. The complexity often comes from the project's dependencies and customization options. Hopefully, future versions will simplify the process.
For CMAKE config, ensure it's properly installed and added to your system PATH. For the module errors, make sure you're in the correct directory and that all dependencies are properly installed.
From what I understand, running PrivateGPT on AMD GPUs can be challenging. You might need to use a CPU-only version or explore alternatives like using WSL2 on Windows.
That's unusual. Make sure you have the latest CUDA drivers installed. Also, check if there are any specific GPU settings in the PrivateGPT config that need adjustment.
Haha, yeah, I understand the frustration. The complexity is due to the project's dependencies and customization options. Hopefully, future versions will simplify the process.
For installing multilingual-e5-base, you can use Hugging Face's transformers library. Try "pip install transformers" and then use the model's Hugging Face identifier.
Make sure you're in the correct directory where the pyproject.toml file is located. Use 'cd' to navigate to the project root before running Poetry commands.
PrivateGPT uses local processing, so your data should remain private. However, always review the project's privacy policy and settings for the most up-to-date information.
The installation process is far too long and convoluted. I think GPT4all had a quicker install process. PS- She clearly wanted to be on the other side of the ocean after those jokes haha
GPT4all is for the maker only, not for all. GPT4all is just a stupid tool that never help with dealing with the docs you provide to. Keeps skipping the provided docs and starts making up some random answers. Most of the time doesn't load docs you provide. Settings shows that you are using GPU but all the work done via CPU. Didn't like it at all.
I apologize for any perceived slowness. AI model performance can vary based on hardware and settings. I'll try to provide more context on expected performance in future videos.
Not sure why everyone commenting negative on narrator. Installation on windows is difficult for privateGPT. I tried and got many errors. This video he explained clearly what errors we may get and how to resolve them. He even uninstalled chocolaty and reinstalled for us to understand how to do that. I like funny narration. Don't know why people can't appreciate genuine efforts.
thank you! 🙏
@@Natlamir i liked the narration and the jokes, i thought it was funny when the ai woman would pop up like she joined the call or something lol
@@Tubby-oq3uu
I like the video very much and the audio is great and inspiring.
Can a chatbot be installed on the Python 🐍 console 🖥 of a program like Paraview?
Paraview is a software to display 3D models and it contains a Python 🐍 console to run scripts for repetitive tasks.
The voiceover made me suspicius but your video helped me a LOT!! Thanks!
Thank you! I'm glad the content was helpful despite any reservations about the voiceover.
Why is the only video that actually gets you a working solution in Windows this one... Great job.
Thank you! I'm happy to hear the tutorial was helpful for Windows users.
Awesome tutorial grandpa... After going through number of tutorials I was literally going to give up but you saved me ... Now I have a place to come if nothing works... 😊
Same!!! This grandpa is a privateHero!!!
@@piezoelectric627 exactly 💯
Thank you so much! I'm glad the tutorial was helpful.
Thank you SO much for this video. I was struggling with the error messages but thanks to your help, I now have this running 💖💖
great!
I wasn't a fan of your character until the first error, then I knew you were the real OG. Like button smashed.
Glad you appreciated the real-world troubleshooting! I believe it's important to show the challenges along with the solutions.
the only video that allowed me to use this stuff. Kudos!
Thanks! Glad the information was helpful.
Appreciate your effort man 😂 Thanks alot eventho I didnt try it yet, but I was just enjoying your video
Thank you for your kind words! I'm glad you enjoyed the video.
thank you so much. i tried via other tutorials but this is the only that worked so far.
installing this is not an easy task as all the steps are scattered all over the internet but you made it easier.
You're welcome! I'm glad the tutorial was helpful in navigating the complex installation process.
Love the narration, specially at 1.5x or 1.75x speed. Great content 👍👍
im still unable to follow his instructions because of his narration
Thank you! I'm glad you enjoyed the narration style.
Simply liking the video wasn't enough. I had to post a comment and also subscribe. Thank you for showing the errors and how to mitigate them. Other tutorials will skip the error side of the work to show how professional they are and ordinary people will encounter to errors. The process is not as fluid as they show. But you made my problems go away. THANK YOU
Thank you so much for your kind words! I'm glad the troubleshooting section was helpful. It's important to me to show the real process, including the challenges.
I was looking for this type of service to process my text locally since centuries, and after I succeeded in the installation and running the program I was so so happy that I came and hit subscribe again and again and again ..... forgot that I am already subscribed 🤣 .... RUclips should put this video on the front page! People, including myself, suffered a lot and couldn't figure out how to setup the latest privateGPTon windows due to many complexities involving the process. Thank you soooooooooooooooooooooooo much! Well, you know what, I might just download this video, its a treasure!
haha aww thank you! that is great that it worked! thank you for the kind words. 🙏
Thanks. Got this to work successfully compared to the Ubuntu based instuctions
Great to hear it worked for you! Windows setup can be tricky, so I'm glad the instructions were helpful.
After Sooooooooo many videos and tries, this method worked. Thank you @Natlamir
I'm so glad it worked for you! Thank you for the feedback.
Thanks for great video. You have saved me a lot of time on how to make privateGPT work locally
You're welcome! I'm happy I could save you some time and frustration.
out of 5 attemps this the only one that has worked for me!, and i don have a clue on how to programm xddddd! congratulations!
great, thanks!
🙏
im getting error "Group(s) not found: ui (via --with)" when executing "poetry install --with ui"
The command changed in the current version. Use "--extras" instead of "--with".
Yeah, as everluck mentioned, maybe try with that. Try using the updated command: "poetry install --extras "
Great video, will wait for the 1 click install lol 🤣
😂
3:00 possible Inception moment if in a future video you refer to this one referring to the first one.
i like this idea, i may have to do that! 😂
Thanks! It has been helpful. 🙂
You're welcome! Glad it was helpful.
Crazy voice, but your tutorial seems the only one on internet to work correctly and no need additional jobs to search installation options except for downloading anaconda from beginning.
Thank you very much!
Maybe you know, can I enable AMD support vith vram512mb?
Thank you for the kind words! Regarding AMD support, it can be tricky. You might need to use a CPU-only version or explore alternatives like WSL2 on Windows.
What happens if you ask it to "create a windows installer for privategpt". Going through all of the rigamarole to install it when it is unclear how the end-product will perform is enough to make me skip it. Just saying..
😂 so true. Creating a Windows installer for PrivateGPT would be a complex task due to its dependencies. For now, I recommend following the manual installation process to ensure proper setup and compatibility.
instead of "poetry install --with ui" try "poetry install --extras "ui llms-llama-cpp vector-stores-qdrant embeddings-huggingface"
Thank you for sharing that alternative command. It's helpful to have different options for troubleshooting.
You made my day dude :D :D :D
I'm happy to hear that! Thank you for the feedback.
thank you grandpa!!!!
important for other student: download visual studio 2022 with C++ CMake integrated component, or u cant build wheel (error)
haha! :D Thank you for the additional tip about Visual Studio components. It's very helpful for others to know.
i sympathize with ur video but it didnt work for me i still get an error after using the prompt from the github user. it might be cuz i have an amd gpu on windows? idk
I'm sorry to hear you're still encountering errors. AMD GPUs on Windows can be tricky with some AI projects. Consider trying a CPU-only setup or exploring alternatives like WSL2 for better compatibility.
And second question - can we make query to this PrivateGPT installation from outside applications? I can't find any information about this.
Regarding language models, check the config.yaml file in the project root for model settings. As for external queries, PrivateGPT typically runs as a local server. Check the project documentation for API endpoints if available.
@natlamir, I’d like to share some ideas with you. Which is the best way to reach you?
i am working on getting contact information created
7:27 Everything is working till this, I've got an error saying:
from tomlkit import array
ModuleNotFoundError: No module named 'tomlkit'
pip install tomlkit doesn't help
@@bradcasper4823 Try running "poetry run pip install tomlkit" within your project environment. If that doesn't work, ensure you're using the latest version of Poetry and that your environment is activated.
@Natlamir I got few more errors to install transformers , huggingface_hub, llama_in , llama_index etc . did it not give these errors for you
I don't remember receiving those errors.
Is visual studio really required? not just the compiling tools?
Visual Studio isn't always required, but the C++ build tools it provides are often necessary. You can try installing just the build tools if you prefer.
Hello for all! Big thanx for your manual! Please answer me, how to change language model to gpt4all or any other? I cant find file .env :(
I haven't tried that before, I wonder if there is something documented on how to do that on their github?
when I run, poetry run python scripts/setup
I now get this error "None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
Traceback (most recent call last):
File "D:\Windows\LLM\privateGPT\scripts\setup", line 8, in
from private_gpt.paths import models_path, models_cache_path
ModuleNotFoundError: No module named 'private_gpt'"
Even after installing torch, I get this error that "no module named private_gpt"
I anyway have to run "poetry install" and it got resolved
@@arvindelayappan3266 Great! Glad you were able to get it resolved.
Thank you. Worked for me too, after some adjustmens.
Could you make a video how to choose a model from hugging face and what the criterias could be for choosing a model.
Nothing there yet, on youtube.
I'm glad it worked for you. Thanks for the video suggestion - I'll consider making a guide on choosing models from Hugging Face.
Muy bueno tu video me gusto mucho gracias
¡Gracias! Me alegra que te haya gustado el video.
its normal the latency when the model its rendering o writing?
Some latency is normal, especially during the first run or with larger models. Performance can vary based on your hardware and the specific model being used.
privategpt is insane if it thinks im going to install conda, poetry, mingw, and all this total bs on my computer! if you really need all this crap, it's time to make it docker compatible, and just have an image.
I understand your frustration. While these dependencies are necessary for the current setup, a Docker image could indeed simplify the process. I'll pass along the suggestion to the PrivateGPT developers.
@@Natlamir sorry for my tone, but yes. it would be simpler.
Do you think there is something similar for reading documents for oogabooga?
Oobabooga has some document reading capabilities. You might want to look into extensions or plugins that enhance its document processing abilities.
For some reason I cannot get the wheel to build for llama-cpp-python
Building wheels can be tricky. Make sure you have the latest C++ build tools installed. If issues persist, try using a pre-built wheel or consider using a CPU-only version. Also, recently when I did an install using a pre-built wheel for llama-cpp-python, I installed the CUDA toolkit of the matching version. For example, try this with CUDA 12.1 installed:
pip install --no-cache-dir --force-reinstall llama-cpp-python --extra-index-url abetlen.github.io/llama-cpp-python/whl/cu121 numpy==1.25.2
Ok, i tried all the stuff... and then... i have a AMD GPU...
AMD GPUs can be challenging with some AI projects. You might need to use a CPU-only version or explore alternatives like WSL2 on Windows.
I was not able to get it to work with vis studio 2022, I had to use 2019 and cuda 11.7.1
Thank you for sharing your experience. It's helpful to know about compatibility issues with different versions.
great
Thank you!
Why cannot this be easier
I understand your frustration. The complexity often comes from the project's dependencies and customization options. Hopefully, future versions will simplify the process.
@natlamir do you have config steps for CMAKE
For CMAKE config, ensure it's properly installed and added to your system PATH. For the module errors, make sure you're in the correct directory and that all dependencies are properly installed.
Is there a way to make it work on an AMD card?
From what I understand, running PrivateGPT on AMD GPUs can be challenging. You might need to use a CPU-only version or explore alternatives like using WSL2 on Windows.
I'm waiting for Video-RETALKING with Gradio 😢
i created a gradio UI for that one a while back: ruclips.net/video/FWptSS09I_A/видео.html
I have an RTX 3050 GPU , when i switched from CPU to GPU it became much slower (3 mins to answer).
anyone knows why ?
There is a line to enable gpu u need to run it if u are using cpu mode already.
That's unusual. Make sure you have the latest CUDA drivers installed. Also, check if there are any specific GPU settings in the PrivateGPT config that need adjustment.
why is this so hard, like aint no way this cant be all done with one installer
Haha, yeah, I understand the frustration. The complexity is due to the project's dependencies and customization options. Hopefully, future versions will simplify the process.
could you do one for installing audiosr?
Thanks for the suggestion. I'll consider making a tutorial on installing AudioSR in the future.
literally nothing worked after 3 days of trying
I'm sorry to hear you're having difficulties.
Hi there ..
Can anyone knows how to install multilingual-e5-base??? or "small"???
For installing multilingual-e5-base, you can use Hugging Face's transformers library. Try "pip install transformers" and then use the model's Hugging Face identifier.
trired: poetry install --with ui
Poetry could not find a pyproject.toml file
poetry --version (works ok)
(privateGPT) C:\ai>poetry --version
Poetry (version 1.7.1)
Did you go back to the original directory? The narrator used private-gpt under his c:\ai root. Once I changed the dir, it worked.
Ensure you're in the correct directory containing the pyproject.toml file. Use 'cd' to navigate to the project root before running Poetry commands.
Poetry could not find a pyproject.toml file in C:
Make sure you're in the correct directory where the pyproject.toml file is located. Use 'cd' to navigate to the project root before running Poetry commands.
Grate video for Windows users ! Please mention your email. I need some advice from one expert as you.
I appreciate your interest. For professional inquiries, I haven't yet added that info, still working on that.
damn, you saved my ass. hugs and kisses!
Thank you! I'm glad I could help.
you didn't pass away did you
haha, been busy with stuff recently, haven't gotten a chance to do more videos.
Jokes are perfect!
Thank you! I'm glad you enjoyed them.
Omg the narration voice is not on point yet, that model needs some fine tuning :p
Thanks for the feedback. I'm continuously working on improving the narration quality.
Stop my destop and not work
I'm sorry to hear you're having trouble.
To understand you need to put a super slow motion video 😡
I appreciate the feedback. I'll consider adjusting the pacing in future videos for better clarity.
It uses lamaindex is this realy private?
PrivateGPT uses local processing, so your data should remain private. However, always review the project's privacy policy and settings for the most up-to-date information.
The installation process is far too long and convoluted. I think GPT4all had a quicker install process.
PS- She clearly wanted to be on the other side of the ocean after those jokes haha
GPT4all is for the maker only, not for all. GPT4all is just a stupid tool that never help with dealing with the docs you provide to. Keeps skipping the provided docs and starts making up some random answers. Most of the time doesn't load docs you provide. Settings shows that you are using GPU but all the work done via CPU. Didn't like it at all.
You're right, the process is quite involved. Hopefully, future versions will simplify it. And yes, those jokes might have been a bit... much! 🤣
why you screaming
lol I love his narration style. too peculiar
TTS-AI David Attenborough voice at like a 1.5x speed. Very amusing!
I apologize if the audio levels were too high. I'll work on balancing the audio better in future videos.
@@rraul Thank you! I'm glad you enjoyed the narration style.
@@vbridgesruiz-phd That's an interesting comparison! haha!
too slowwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
I apologize for any perceived slowness. AI model performance can vary based on hardware and settings. I'll try to provide more context on expected performance in future videos.