I get a ton of hallucinations using basic RAG with this. Pretty much unusable if I can’t figure out how to reduce them. I’m sure a lot of it is due to the 8B version of Llama 3.1.
Are there any selfhosted interfaces which I can use as a central UI for multiple different LLM Providers? In this Application it seems that you have to manually swap the Provider.
It's open source and free, you can run it on your own computer. We offer a fully managed version on Elestio starting at $10/month (vary based on provider/region/size you select)
![Seungmin "그렇게, 천천히, 우리(As we are)" | [Stray Kids : SKZ-PLAYER]](http://i.ytimg.com/vi/kAzmhLHePqU/mqdefault.jpg)
Just wanted to comment on the amazing work on this channel. Lots of interesting stuff, thank you!!!
The installation on Elestio was very easy to follow. Elestio has servers in the EU, which is important from a GDPR standpoint.
Say there was a rather large file server with many word documents, excel files, PDFs, etc. would it be possible to index/embed it ?
I get a ton of hallucinations using basic RAG with this. Pretty much unusable if I can’t figure out how to reduce them. I’m sure a lot of it is due to the 8B version of Llama 3.1.
Thanks....great work
Thnaks
Are there any selfhosted interfaces which I can use as a central UI for multiple different LLM Providers?
In this Application it seems that you have to manually swap the Provider.
Thanks
real cost?
It's open source and free, you can run it on your own computer. We offer a fully managed version on Elestio starting at $10/month (vary based on provider/region/size you select)
@@elestio
Can we host llama or other open source LLMs on the same vps?? So it becomes totally self hosted ???