Would be nice you to create some external NPU, for example, USB, or Thunderbolt 4 because most people don't have necessary hardware for local AI and to buy a new computer is tricky
I want to run a SLM locally and have it trained on all the source code I have ever written. Then I want it to help me fix the problems and make it better. I don't want to use github copilot because I got some security sensitive data. I have tried LM Studio, but so far it's still copy/paste stuff... too much trouble.
Would be great to have a demo on how you fine tune it and how you deploy it for inference
Checked. I have installed AI Toolkit for VS Code
Where is the link in the description
great!
Looks awesome! Any plans for Visual Studio 2022 support? 🙂
Visual Studio is the new Silverlite.
Where is a Mac OS version?
Would be nice you to create some external NPU, for example, USB, or Thunderbolt 4 because most people don't have necessary hardware for local AI and to buy a new computer is tricky
I want to run a SLM locally and have it trained on all the source code I have ever written.
Then I want it to help me fix the problems and make it better.
I don't want to use github copilot because I got some security sensitive data.
I have tried LM Studio, but so far it's still copy/paste stuff... too much trouble.
It's like ollama, isn't it?
Seems like it
I did a video on how to fine-tune a model with AI Toolkit in VS Code here ruclips.net/video/b23mQEHVf5U/видео.html . Thanks.
As long as there is No MacOS Version. It did Not Happen.