Don't load a huge dataset. I uploaded every college digital file I had and the thing went crazy. After a few hours of it trying to "digest" the data I killed the program and had to reinstall because there doesn't seem to be a way of telling it to stop reading your data. I'll try again with a way samaller dataset as you did in the video.
Don't. After some testing I can tell you it's quite useless. The answers it provides are very bad and short. It doesn't care that much about the data you provide it with. Bare in mind it's a "demo". Maybe in a few months or years it becomes decent. For now, just get chatGPT 4 instead@@gordonthomson7533
My GPU is an older RTX 2070. After downloading this nvidia package, I realised it's not going to run on my GPU. I created a similar chat bot that can do Q&A using a pdf file of your choice. I'm using llama-2-7B there. I had to use Google Colab to get 16GB GPU. But man, it's so slowww.. @Daniel Can you please do a video on pdf chat using langchain and one of those free LLM models?
Did you have any errors when you installed the software? I have had numerous errors with the sentence-transformers not being installed. Can anyone help with this?
Thank you very much as always. Though out of the context of tis video, i was wondering what would be the replacement for Tensorflow examination Certificate since it would be discontinues on 31st of may this year ? and also , would be possible to make video about the available Certificates online ? since your expertise opinion on each Certificate would be Gold ! thank you
Will this on my RTX 3060 ? I have a laptop. Wish I bought the RTX 3090 back then, I could have afforded it. Still can but now I am hearing of layoffs in my org, so I am gonna have to save up in case I get axed. EDIT: It doesn't seem it can. I wish my 3060 had like 16 gbs of VRAM :(((((
Thank you for the very comprehensive tutorial! I'm interested in creating an interactive chat BOT to respond to Facebook messages related to medical topics. What I'm asking is, given the issues some have reported regarding the management of very large datasets of scientific articles, how can we obtain a system that is both comprehensive and effective? How can we organize the material questions correctly to make the most of the program's capabilities? Thank you.
🎉 Thank you! This is just the kind of video I've been hoping to find
Good timing!
@@mrdbourke It worked flawlessly
Don't load a huge dataset. I uploaded every college digital file I had and the thing went crazy. After a few hours of it trying to "digest" the data I killed the program and had to reinstall because there doesn't seem to be a way of telling it to stop reading your data. I'll try again with a way samaller dataset as you did in the video.
What GPU are you running?
I’m awaiting 4080 super and hoping to squeeze a load of value via this…
Don't. After some testing I can tell you it's quite useless. The answers it provides are very bad and short. It doesn't care that much about the data you provide it with. Bare in mind it's a "demo". Maybe in a few months or years it becomes decent. For now, just get chatGPT 4 instead@@gordonthomson7533
Well context size is limited
can i use it to translate a pdf from english to other languages by keeping the same style and designs of the pdf?
When I try to upload a pdf chat with rtx cannot find it. The file is in .pdf. Any tips to get this working?
I don't see the point of this (very limited) over something like LM Studio or ollama+open webui.
best youtuber out there
you are back at last.
yo yo yo!
what is best hardware required ?
My GPU is an older RTX 2070. After downloading this nvidia package, I realised it's not going to run on my GPU.
I created a similar chat bot that can do Q&A using a pdf file of your choice. I'm using llama-2-7B there. I had to use Google Colab to get 16GB GPU. But man, it's so slowww..
@Daniel Can you please do a video on pdf chat using langchain and one of those free LLM models?
Did you have any errors when you installed the software? I have had numerous errors with the sentence-transformers not being installed. Can anyone help with this?
Did you find a fix yet? I had the same problem which was addressed on a forum and the solution solved the issue for me.
Yeah make an app like this
I have a 4070, but i cant get it to work due to some strange dependency.
Which one is that? Have you installed NVIDIA drivers?
😮
When it will be available for 4Gb Rtx3050
Do you know whether is it possible to have something similar to DALL-E with this tool?
This is awesome, but I don't own a GPU yet, still learning!!
very detailed use case. thankyou
Quadro T600 can run it ?
This beautiful RTX 4090 is love. I wish I had one. If you ever feel like donating, sign me up.
Thank you very much as always. Though out of the context of tis video, i was wondering what would be the replacement for Tensorflow examination Certificate since it would be discontinues on 31st of may this year ? and also , would be possible to make video about the available Certificates online ? since your expertise opinion on each Certificate would be Gold ! thank you
this used to work fine but after changing my folder path for the docs, I can no longer open it. I wish I can change it somehow without opening it
dude.great job
Will this on my RTX 3060 ? I have a laptop.
Wish I bought the RTX 3090 back then, I could have afforded it.
Still can but now I am hearing of layoffs in my org, so I am gonna have to save up in case I get axed.
EDIT: It doesn't seem it can. I wish my 3060 had like 16 gbs of VRAM :(((((
That’s odd, minimum is 8gb
Thank you for the very comprehensive tutorial! I'm interested in creating an interactive chat BOT to respond to Facebook messages related to medical topics. What I'm asking is, given the issues some have reported regarding the management of very large datasets of scientific articles, how can we obtain a system that is both comprehensive and effective? How can we organize the material questions correctly to make the most of the program's capabilities? Thank you.
This is not the right tool for that job. You'd have to fine tune a model for this
can it run on rtx2050 ?
no
You could try, however, the system requirements do say to use a 30XX or 40XX series GPU