What they didn't tell you about Falcon 180b (and will it change?)
HTML-код
- Опубликовано: 5 окт 2023
- 👨💻 Sign up for the Full Stack course and use RUclips50 to get 50% off:
www.coursesfromnick.com/bundl...
🐍 Get the free Python course
go.coursesfromnick.com/python
Hopefully you enjoyed this video.
💼 Find AWESOME ML Jobs: www.jobsfromnick.com
🤖 Get the Code:github.com/nicknochnack/Falco...
Check out Falcon 180b the all new model from TII UAE.
Falcon 180b was released on the 6th of September 2023 by the TII UAE. It's a 180 billion parameter decoder only model that was trained on 3.5 billion tokens with a context window of 2048 tokens. What makes it unique is that it performs exceptionally well with the authors claiming it ranks just behind GPT4 and on par with Google’s PaLM 2 Large, in spite of being half the size of that model.
Oh, and don't forget to connect with me!
LinkedIn: bit.ly/324Epgo
Facebook: bit.ly/3mB1sZD
GitHub: bit.ly/3mDJllD
Patreon: bit.ly/2OCn3UW
Join the Discussion on Discord: bit.ly/3dQiZsV
Happy coding!
Nick 
Наука
I spent way too much time trying to add a trucker hat to the baby falcon in the thumbnail. 🫠
We need more projects, Nick.
3:42 An important detail of this model is that it is NOT open source. It prohibits "Hosting Use" and has an "Acceptable Use Policy" that can be updated at any time with retroactive effect.
Great to see you back with your videos. As for the topic, I see the world has also turned more actively into researching for smaller models. There're some really interesting ones have appeared recently: DeciLM promising x15 llama2 speeds, long llama from meta with 32k of context out of the box, Mistral 7b which is beating most of 14b models, Stable LM 3b which is small but still good at the bunch of NLP tasks, and Phi 1/1.5 from MS which were fine tuned by community for instruction following
Nick, the video was amazing!!, could you do more videos on LLMs. How the quantized and shared models actually works.
Interesting to think that it’s not more parameters needed to make a better chat model, but rather some other factor. It’s probably the secret factor that makes GPT-4 so powerful
Yes, a lot of fine-tuning and cleaner data
Hi Sir nicho, I just want to ask about the video you posted about real-time sign language detection using tensor flow and Python. Since many signs involve some type of movement, I wonder if videos could be used in place of pictures. I know it's not related to this video you posted, but I hope you can reply to me because your video is very helpful for us in our research. Thanks in advance.
please do a video about multiclass classification .
or try to train your model (ex:knn) using a dataset and show as how to preprocess and train it with some advice
Hey Nick, I'm learning a ton from you! You're incredible! Love from South Africa.
Ayyy! Stoked you’re enjoying the vids! 🙏
You're doing amazing Nicholas. Had a project in mind of generating NBA players in different jerseys using generative AI. Any advice?
Hey , can u make a video on image captioning please ....
hi Nicholas! I think your discord link expired, I need help on something for your "Tensorflow Object Detection in 5 Hours with Python | Full Course with 3 Projects" video. What are alternatives for coda and cudnn since they arent supported on Mac anymore and how do they integrate into that video
Where can I test this model without installing it?
I love your videos, you are amazing and your knowledge wow!
Thanks a mil man 🙏
can you make a tutorial for virtual mouse AI development using the hand gestures ? i really need your help thank you
Thank you for the great video.
can you make a video on how can we use local falcon to chat with our data
Great content. This bloke guy is beyond a giga chat :')
hallo a request can you make video on sign language production where an animated individual talk with sign language
Hey nick can you please do a video on imitation learning...i think it is so fascinating and exploring more into it, maybe you'd like it too
You got it!
Bro we are missing you :/ Where are you ?!
Building some stuff, got it all coming soon 😉
@@NicholasRenotte :D thanks
Do you know that someone really developed a gpt investment banker like you did and won a hackathon It's slightly different but the idea is the same .I immediately remembered your video.
Man ! For what you are doing and how you are doing it people must be jealous !🤣🤣🤣🤣🤣 u deserve to be a president be we want you here ! 😃
plz make a VIDEO on ML and DEEP LEARNING setup in mac book air M1 in entire youtube there is no such a perfect video for this setup
Nothing here that a 7B can't do.
Make mentalities ai using body language
ASSOCIATE SYSTEMS ENGINEER
BRO IF YOU KNOW ANYONE AT IBM INDIA HELP ME GET A REFERRAL