STOP Building AI SaaS ONLY on OpenAI APIs!!!
HTML-код
- Опубликовано: 7 сен 2024
- This video offers some great AI API solutions and some open source projects to host your own models! The objective of this video is to make you rely less on OpenAI and build better more reliable GPT wrappers that aren't only from OpenAI APIs aka AI SaaS.
🔗 Links 🔗
replicate.com/...
huggingface.co...
www.together.a...
cohere.com/pri...
blog.perplexit...
www.anthropic....
Open Source Projects to make AI Hosting easier
github.com/oob...
github.com/sky...
github.com/Ber...
github.com/Pre...
github.com/vll...
github.com/mlc...
Hamel's blogpost - hamel.dev/note...
❤️ If you want to support the channel ❤️
Support here:
Patreon - / 1littlecoder
Ko-Fi - ko-fi.com/1lit...
🧭 Follow me on 🧭
Twitter - / 1littlecoder
Linkedin - / amrrs
Here is my vLLM Tutorial (with hands-on code) - ruclips.net/video/G7rXlZR68SQ/видео.html
I 100% agree with you, we have to push open source models for the sake of the mankind
Thanks for being on the journey!
I agree with you. I think we need to push open source models.
Refreshingly NOT regurgitating the useless Drama!
THANK YOU!
Please do a deep dive series on this!
Take each one and discuss pros and cons.
I see this as your Niche!
Keep it coming!
I don’t use closed source models, except for testing and basic study, I’m not even interested in that set of new things… it’s only now they know how to force model to answer in JSON!!! I knew it for several months now, and it’s even without training!!! and this knowledge is not even required with mistral.
🎯 Key Takeaways for quick navigation:
00:54 📢 *The video is not sponsored; the speaker's recommendations are based on personal experience and opinion.*
01:09 🌟 *Replicate is highly recommended for image generation, especially for independent developers.*
01:50 🚫 *Popular cloud solutions like AWS, Microsoft Azure, and Google GCP are intentionally omitted from this discussion.*
02:17 🧠 *Hugging Face's Inference Endpoint is a notable solution for deploying AI models with various cost options.*
05:02 💡 *Emphasizes the importance of having fallback solutions and a tiered approach in AI development for reliability.*
The future's so bright, He's gotta wear shades !!
Again and again and again, great video. Thanks so much man!
Thanks a lot for the video, however there is big problem in all of these solutions, all of them are not powerful if you want to serve MultiLingual SaaS. this is the biggest thing that led me to use Openai API for my SaaS.
I can understand that but like I mentioned in the video these are could augment well as supplements. But your points stay true that the main meal could be openai for a lot of usecases.
Thank you so much again, sir! Your channel is the absolute best.🎉
Runpod community pods are distributed and cost-effective.
Thank you so much you made it all clear 👌
Glad it helped!
Please push more non-openai, open source or self hosted solutions. Also hightlight and be honest on their problems, and potential tradeoff and solution for the problems.
Yes tried to highlight some problems in this video as well. Will continue to do zo
!
@@1littlecoderYou are doing great 👍
Thanks for the video about api inference👍. Open source is my favor 2
I think we can try fireworks ai api it's great and has most of the open source models🎉
I leave OpenAI like Sam Altman.
Poetic!
Thank you. What about S-LoRa? And, tinygrad?
I just started digging into llamaindex. I'm attempting to build my own datalake. Know of any tools for the data viz side of the LLM?
Anthropic not available for use..api
The API has its own waiting list so it might take time I guess
Great video as always 🙏🙏
I have tried LLaVA(upload image and ask question) with image with text on it but it could not extract the text on the image. can you please suggest an alternative to do this. Thank you
There was a comment here suggesting you to try tesseract, strangely it's not there now, maybe youtube removed it! But tesseract is something you can try if you're trying to do only OCR!
@@1littlecoder thanks bro. is there a way to do both automatically based on the input image
@@quotesspace1713yes, there is, you can just script this pipeline now in python, I did that - generated description, made model look at it, and suggest fixes, apply fixes with the model and again😂
@@quotesspace1713try document ai or Google OCR in chrome browser
frist post
I missed the part where you explain why to stop using OpenAI APIs. I am still looking for help connecting an openai assistant with my Joomla 4 site. I think Joomla is blocking http requests.
Good to see Joomla in 2023 :) why do you think it's blocking ? Is it allowing normal requests?
@@1littlecoder Yes, I have been using Joomla for 16 years :) but I am not a coder. I have this custom html module that allows php and scripts so I have the php that includes the openai api and assistant ID but I cannot get seem to get it to connect with the api key or assistant ID I need to pay you to help me :) But yes, normal 3rd party jomla ai modules will connect. I just cannot get my custom module to connect so I can use an assistant that I can configure on the openai site
Can you mail me 1littlecoder at gmail let's see
Thanks
You are very welcome Nithin!
which service provide statefull api?
Claude 2.1 just went up to 200k tokens,and they lowered the price today.
Thanks, great content as always
What about non English and non European languages LLMs?
I’ve trusted open source LLM’s but unfortunately none of them are close to gpt4.
helpful.
Can you make a video for text gen too?
Can i know your name? I wanted to ask what googles are you using to protect your eyes?
I find problems and then find solutions. I don't obsess over tools.
Bro show api which are free to user so that we can practice some things
Anything I do for serious is not running anything closed. I have a hard time understanding why anyone would trust another company for their livelihood if they had a choice.
What's your favorite model now?
@@1littlecoder TheBloke • neural chat v3 1 7B
or
Yarn-Mistral-7b-128k
depending on the task.
I use the chinese stuff for interrogating images.
And I do regrettably still use gpt4 for some coding help but I don't hook into the api for anything in production.
Him leaving has everyone realizing how bad his idea of pushing so hard for market dominance was. Centralizing AI under one company, and all other major companies becomming leashed to that is just another way of materially centralizing the nervous systems of those companies. In other words: a really bad idea.
why did you use sun glasses, brother? did you get eye-ache?
is there any reason why you are wearing sunglasses? does it add value to your speach?
The sunglasses are cool, but why?
Style points baby!!😎
Maybe suffering from an eye flu or followed open AI drama night and day 😅 😉
bhai ye goggle accha nhi dikh raha hai
Bro why are you wearing huge glasses. Hope you are fine
What about non English and non European languages LLMs?