- Видео 35
- Просмотров 6 922
Diogo Neves
Великобритания
Добавлен 28 мар 2006
Taking code to places 🚅🧑💻
Currently at Glyphic AI and Metaphora Studios
Former Apple (AIML) and Sony PlayStation Software Engineer
Finding hope and change through code and building stuff!
Also 🔴 live on Twitch (sometimes)
Currently at Glyphic AI and Metaphora Studios
Former Apple (AIML) and Sony PlayStation Software Engineer
Finding hope and change through code and building stuff!
Also 🔴 live on Twitch (sometimes)
Boost Your AI Models: Insights from GenAI London 2024
Explore the latest in AI as we travel to London, check out a cool office building, and share some insights from GenAI DevCon London 2024.
As always, I ended the video feeling like there was a lot more to cover. I'll be diving deeper into some of these subjects with actual projects soon! Don’t forget to subscribe to get notified when those videos come out. Share your thoughts, questions, and suggestions in the comments below!
*Links and Resources*
- *MergeKit:* Enhance your AI models by merging them efficiently github.com/arcee-ai/mergekit
- *Anthropic Research:* Mapping the Mind of a Large Language Model www.anthropic.com/news/mapping-mind-language-model
- *Mike Taylor's Book:* Prompt Enginee...
As always, I ended the video feeling like there was a lot more to cover. I'll be diving deeper into some of these subjects with actual projects soon! Don’t forget to subscribe to get notified when those videos come out. Share your thoughts, questions, and suggestions in the comments below!
*Links and Resources*
- *MergeKit:* Enhance your AI models by merging them efficiently github.com/arcee-ai/mergekit
- *Anthropic Research:* Mapping the Mind of a Large Language Model www.anthropic.com/news/mapping-mind-language-model
- *Mike Taylor's Book:* Prompt Enginee...
Просмотров: 277
Видео
How to Run Local AI Models - in 5 minutes
Просмотров 795Месяц назад
*How to run Local AI Models, in 5 minutes, using LM Studio* You don't have to always pay for OpenAI or Anthropic APIs. In this video, I'll show you how to set up and run Open Source LLMs on your machine with LM Studio. It is completely free and private too! 📥 Download LM Studio: lmstudio.ai I downloaded Llama 3 7B and have experimented with Llava. Check HuggingFace at huggingface.co *Alternativ...
Interesting idea… my first concerns would be of mean reversion kicking in when combining different models, that or overfitting when combining the same one. Have to try it out though
That is spot on! You explained it better than I did (when I mentioned "amplifying some weights" I guess that's better expressed with overfitting). Your concerns are exactly why I do not understand how it could work. I am also considering: - Maybe the process of merging has some "unintended" side-effect that may be the cause for better results. (I don't yet know how to test this) - Maybe merging reduced previous overfitting in the network, by applying changes that were not present during training, leading to slightly better generalisation. (This could be tested by disrupting the network with noise, or "merging with a noisy model" and see if the effect persists.) What do you think?
Have you tried MergeKit or know of any other alternatives?
U need a supercomputer for this. The regular m.2 mac, can’t handle this. Way too slow…
It needs a fair bit of memory, I’m running on an M1 Air with 16GB Which models have you tried? Start with a smaller one. How much memory do you have? Soon I am going to show a lighter approach that although slow, runs on a raspberry pi
I've been using LM Studio as it just works. Super easy to build plugins with the server as well to get functionalities that aren't in the app.
@@yorkie4k totally! I’m now also looking into Llamafiles and SQLite-vec. Both really cool too, but LM Studio is still the simplest and most accessible I know Do you use LM Studio just for the chatbot? Or are you building something with it? Would love to learn more 😉
@@DiogoNeves I've built my own RAG app for it. If you're in the LM Studio discord you'll see my post on it.
For me it helps to think that I'm talking to someone I know. Imagine you're in a meeting or something. Not that I'm creating anything.
@@endianAphones thanks 🙏 definitely will use that next time!
Finally, I found a well-made, no-frills, guide to installing local LLMs!
@@luciferovonnachtosphere thanks 🙏 I really appreciate
I'm much preferring LM Studio than GPT4All - thanks for the tutorial :)
@@aca95aks thanks 🙏 yes, I really like the simplicity and interface of LM Studio. Have you tried any of the other alternatives like Ollama?
This is the first tech tutorial I've ever seen that was recorded in the woods!
@@danielhabibio thanks! The coming videos should also have an outdoor twist too 😉 hopefully gets more people in the flow and woods are just awesome. P.s. I promise I’m not building a bunker in the woods to hide from our AI overlords 😉
Tysm
Wow! That looks so cool!
We were together this day 😊
Nice donut!
Adorable.
Awww this is so cute 🥰
Thanks!! A friend of mine is considering creating a website so that anyone could easily make these stories. I really like the idea
😢