Excellent video. Suggesting to optimize the video more in terms of description and keywords so that you end up getting more search traffic. Please keep up the good work.
You make a good point, nothing is truly free. However, I still think what meta is doing by open sourcing a top tier model is a big deal. It allows the entire universe of cloud providers to host llama, not just being stuck with a few big tech companies gatekeeping. Also puts downward pressure on AI API pricing in general.
export is used for bash and zsh shells which are in mac. You might probably be in windows powershell so use the command $env:GROQ_API_KEY="YOUR_API_KEY"
Thanks , but It can extract data from images ? I tried llava but it gave me a bad result Always say that the image provided doses not have good resolution ? Can you please make a video about that like you did with gpt4 for conversion img to json
why I have this error? export GROQ_API_KEY="my_api_key" export: The term 'export' is not recognized as a name of a cmdlet, function, script file, or executable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again.
its likely you are trying to run export in a windows environment. Try set GROQ_API_KEY=my_api_key...google setting windows environment variables if that doesn't work
personally, I use Groq for more proof of concept type projects, and do not send sensitive data. A key note from Groq: Notwithstanding the restriction on licensing set forth in section 4, Content Available through the Services, User Data shall be owned by you and is not retained or used by Groq other than to perform the Generative AI Services hereunder. Also, groq.com/security/
@ i did not yet, it seems that llama works well with csv files but excel is a bit of drama. You could look into gemini since that is integrated with google sheets, but might be less secure for your data
This seems to be a real game changer for developers, but something feels off. What are caveats of running groq + llama 3 for free? What are limitations? Why is everyone and their grandmother not creating apps with this exact set up right now?
Their is rate limits (I will put them below), so to use it with any volume you would need an enterprise plan. But I still think this is a game changer not just from what groq is doing but in that you now have a top tier model that is open sourced. This allows us to setup our own high performance llm without having to always go through a few megacap tech companies. the limits for llama3-70b-8192 are 30 requests per minute & 6,000 tokens per minute. Also max 14,400 requests per day.
When I´m in the terminals while adding the "pip install groq" it says pip : The term 'pip' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again. At line:1 char:1 + pip install groq + ~~~ + CategoryInfo : ObjectNotFound: (pip:String) [], CommandNotFoundException + FullyQualifiedErrorId : CommandNotFoundException
This error shows up on windows when one tries to use pip in the command prompt. To solve this error on windows, you must declare path variable by following these steps: -Right click on My Computer or This PC -Click on Properties -Click on Advanced System Settings You will find a section called system variables. Click on Path from the list of variable and values that shows up there. After clicking on path click edit. You will find a New button in the pop up. Click that and paste the location of the python35 or python36 folder (The location you specified while installing python) followed by \Scripts there. For me its C:\Users\suee\AppData\Local\Programs\Python\Python35-32 so I type C:\Users\suee\AppData\Local\Programs\Python\Python35-32\Scripts Click Ok to close all windows and restart your command prompt. I repeat - restart your command prompt. Everything should now be working fine! Make sure you don’t disturb anything else in the path variable and follow the aforementioned steps exactly.
Hi , is it imp to download the model and do the setup or just calling api in backend is enough to get ai response does meta provide the api service since i dont know python I rely on api only 💀
Great vid! I could manage to make it work, but not with all the code you gave. Either it writes an empty .md or else I erase some of the code and gives me the cv on the output console but it doesn´t create the .md file. This is the error I get: "line 36, in output_file.write(completion.choises[0].message.content) AttributeError: 'Stream' object has no attribute 'choises'" Could you give me some hints?
Hey Thanks for watching. I will post a link to the GitHub with the starter code shortly. Noticed you have a typo in the word choices, should be: completion.choices[0].message.content
At a high level you want to implement a service class that will handle the API calls(the code from this video would go in that class). Then use the service in your controllers or other components. ChatGPT or Claude could walk you through it in some more detail, good luck!
yes its free, no credit card required even. It does have some request limits but they are pretty high last time I checked. I am a bit surprised it is still totally free with such high usage limits...
Short,Conscise and perfect. This is one of the best videos on the topic!
Excellent video. Suggesting to optimize the video more in terms of description and keywords so that you end up getting more search traffic. Please keep up the good work.
Thank you, and thanks for the great suggestion. You are right I will add more to the description
Thank you very much, I saved a lot of my time with this video. Very very good!
If it's free your prompt content is being saved. 70b costs lots of money to run on a server like this, it's not free!
You make a good point, nothing is truly free. However, I still think what meta is doing by open sourcing a top tier model is a big deal. It allows the entire universe of cloud providers to host llama, not just being stuck with a few big tech companies gatekeeping. Also puts downward pressure on AI API pricing in general.
So what if the prompts are saved, it just makes the model better
@@jonahsatheesh5346data is the new oil. your personal data is actually worth money. you are trading it to use the product.
Agreed. But for learning purpose it's good. For actual enterprise application your company will bear cost of hosting of Api
it says the term export is not recognized can some one help me? untile 1:42 everything was working
Hey sorry for the late reply. My best advice is use cursor AI code editor and put the error you get in the chat. It will likely fix it right away
@@aiunleashed509 ok im currently not home but when i will get home i will write it
export is used for bash and zsh shells which are in mac. You might probably be in windows powershell so use the command $env:GROQ_API_KEY="YOUR_API_KEY"
Can I use it for langchain developing RAGs with chat history, not providing sensitive information?
Yes you can use it in Langchain. Not sure exactly what your doing, but think of if as a free alternative to using OpenAI GPT4o paid credits
when i am executing it as simple function it works
but creating an API via express its giving 401 invalid token error ?
Hey, I would try loading the relevant files into Cursor composer, and pasting in the error.
Finally i found quality video to find free api key of llama ,that's great & thank you sir
Thanks , but It can extract data from images ?
I tried llava but it gave me a bad result
Always say that the image provided doses not have good resolution ?
Can you please make a video about that like you did with gpt4 for conversion img to json
I don't think you can use this method for AI vision. Working on a video about AI vision with Claude
what is the limit??
console.groq.com/settings/limits
for most people with free account llama 3.3 will be 30 requests per minute, 1000 per day
@@aiunleashed509 thx u
why I have this error? export GROQ_API_KEY="my_api_key"
export: The term 'export' is not recognized as a name of a cmdlet, function, script file, or executable program.
Check the spelling of the name, or if a path was included, verify that the path is correct and try again.
its likely you are trying to run export in a windows environment. Try set GROQ_API_KEY=my_api_key...google setting windows environment variables if that doesn't work
You're in windows. Export command is for linux/macos. Google the ways
That's great. Thanks for the video, sir.
Is your data secure if you run it through Groq? i want to use llama on excel data but don’t want to leak information.
personally, I use Groq for more proof of concept type projects, and do not send sensitive data. A key note from Groq:
Notwithstanding the restriction on licensing set forth in section 4, Content Available through the Services, User Data shall be owned by you and is not retained or used by Groq other than to perform the Generative AI Services hereunder.
Also, groq.com/security/
did you find a solution for your issue? I am also looking to find a way to use llama models on some google sheets.
@ i did not yet, it seems that llama works well with csv files but excel is a bit of drama. You could look into gemini since that is integrated with google sheets, but might be less secure for your data
Any idea what the rate limits are? Couldn't find that information on google :/ I only saw the max tokens per request.
Yes the limits for llama3-70b-8192 are 30 requests per minute & 6,000 tokens per minute. Also max 14,400 requests per day.
How much data can be transferred per request? I'm a newbie
@@ianbraganza3065 6000 tokens per minute. A token is about 3 characters of text, so around 18k characters per minute
This seems to be a real game changer for developers, but something feels off. What are caveats of running groq + llama 3 for free? What are limitations? Why is everyone and their grandmother not creating apps with this exact set up right now?
Their is rate limits (I will put them below), so to use it with any volume you would need an enterprise plan. But I still think this is a game changer not just from what groq is doing but in that you now have a top tier model that is open sourced. This allows us to setup our own high performance llm without having to always go through a few megacap tech companies.
the limits for llama3-70b-8192 are 30 requests per minute & 6,000 tokens per minute. Also max 14,400 requests per day.
When I´m in the terminals while adding the "pip install groq" it says
pip : The term 'pip' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling
of the name, or if a path was included, verify that the path is correct and try again.
At line:1 char:1
+ pip install groq
+ ~~~
+ CategoryInfo : ObjectNotFound: (pip:String) [], CommandNotFoundException
+ FullyQualifiedErrorId : CommandNotFoundException
This error shows up on windows when one tries to use pip in the command prompt. To solve this error on windows, you must declare path variable by following these steps:
-Right click on My Computer or This PC
-Click on Properties
-Click on Advanced System Settings
You will find a section called system variables. Click on Path from the list of variable and values that shows up there.
After clicking on path click edit. You will find a New button in the pop up.
Click that and paste the location of the python35 or python36 folder (The location you specified while installing python) followed by \Scripts there.
For me its C:\Users\suee\AppData\Local\Programs\Python\Python35-32 so I type C:\Users\suee\AppData\Local\Programs\Python\Python35-32\Scripts
Click Ok to close all windows and restart your command prompt.
I repeat - restart your command prompt.
Everything should now be working fine! Make sure you don’t disturb anything else in the path variable and follow the aforementioned steps exactly.
Hi , is it imp to download the model and do the setup or just calling api in backend is enough to get ai response does meta provide the api service since i dont know python I rely on api only 💀
No you don't need to download the model. In this video it's run in the cloud with groq(not meta directly).
Thanks a lot. It was truly helpful
Hi,
Is there a way for the code from this video to be posted?
Yes, here it is: github.com/AI-Unleashed/GroqResume
Can I use this free API for n8n without coding?
I'm a newbie 😊
Hi! haven't used it myself but it looks like they have a Groq Chat Model integration: n8n.io/integrations/groq-chat-model/
Thanks! Super helpful and straight to the point
Great vid! I could manage to make it work, but not with all the code you gave. Either it writes an empty .md or else I erase some of the code and gives me the cv on the output console but it doesn´t create the .md file.
This is the error I get: "line 36, in
output_file.write(completion.choises[0].message.content)
AttributeError: 'Stream' object has no attribute 'choises'"
Could you give me some hints?
Hey Thanks for watching. I will post a link to the GitHub with the starter code shortly. Noticed you have a typo in the word choices, should be: completion.choices[0].message.content
Thank You so much sir for providing such rare information , I can now use powerful ml models for free
i want to use it in spring boot project how to do that
At a high level you want to implement a service class that will handle the API calls(the code from this video would go in that class). Then use the service in your controllers or other components. ChatGPT or Claude could walk you through it in some more detail, good luck!
Wait what so this is completely free?
Yes! at least for now :-)
so amazing! Thank you so much
I don’t think this is free, just checked they charge for tokens
Is it still free?
yes!
Amazing. Thank you. got my sub :)
Super super good!!!!
Thanks glad it was helpful!
Is it free? and No Limits?!
yes its free, no credit card required even. It does have some request limits but they are pretty high last time I checked. I am a bit surprised it is still totally free with such high usage limits...
@@aiunleashed509 Wow, I'll try this, BTW Thank you.
so usefull, i like it
You're awesome!
Thanks, comments like this keep me going. You're awesome too!
THE GOAT💎💎
Thank you, please post source code next time ! :)) I havу tested it, works perfect
thanks
Its free as of the moment LOL
when i do the 'python project.py' step in terminal it doesnt work. how to fix this?
what error do you get?