Fine-Tune LLM in VS Code AI Toolkit Locally on Custom Dataset

Поделиться
HTML-код
  • Опубликовано: 2 дек 2024

Комментарии • 22

  • @fahdmirza
    @fahdmirza  5 месяцев назад +1

    🔥Install Visual Studio AI Toolkit Locally in Windows ruclips.net/video/7dZjUH28EyA/видео.htmlsi=WaiKc-Sfb5WGTECo

  • @therobotocracy
    @therobotocracy 5 месяцев назад +1

    Man, you are on this stuff so quickly! Thanks!

  • @bomsbravo
    @bomsbravo 5 месяцев назад

    Thank you so much for making this video. I never thought you would create a video on this with such little time. I love your work and I think you are the best AI guru out here on RUclips!

    • @fahdmirza
      @fahdmirza  5 месяцев назад

      You are welcome

    • @bomsbravo
      @bomsbravo 5 месяцев назад

      @@fahdmirza I managed to get the project done. So now how to run this? Can we use LM Studio to run the model we created? Or can we use the playground in the VS code to run it?

  • @youdaloser1
    @youdaloser1 5 месяцев назад

    This is a great video but I am having difficulties setting up my environment correctly. I keep getting a "Conda not detected" error in my WSL environment but I am able to make calls to conda in the command line. I updated the settings.json file in the ubuntu environment all sorts of things. It seems like an issue with the AI Toolkit not recognizing conda. Thoughts or advice?

    • @fahdmirza
      @fahdmirza  5 месяцев назад

      would need to check when time permits

  • @skillhood5459
    @skillhood5459 5 месяцев назад

    how do we query the fine-tuned model? and post this how can we deploy said model to an app or a website?
    Thanks

    • @fahdmirza
      @fahdmirza  5 месяцев назад

      would need to check when time permits

  • @bomsbravo
    @bomsbravo 5 месяцев назад

    Can you do another video on how to test out this model? I manged to create the project but I am lost there. I couldn't not find any details on how to run it. I think the playground is supposed to be running them but it is not working. Can you create the next part of this video showing how to actually run these fine tuned models? Either on Hugging face or locally.

    • @fahdmirza
      @fahdmirza  5 месяцев назад +1

      Noted, when the time permits.

  • @stask7258
    @stask7258 5 месяцев назад

    Thanks.

    • @fahdmirza
      @fahdmirza  5 месяцев назад

      You're welcome

  • @figs3284
    @figs3284 5 месяцев назад

    Can you find a good synthetic dataset generator for a codebase?

    • @fahdmirza
      @fahdmirza  5 месяцев назад

      plz search channel, there are already many videos around that

    • @figs3284
      @figs3284 5 месяцев назад

      @fahdmirza sorry, I don't think I was specific enough. What I mean is. Generating a synthetic dataset, that is seeded by a codebase (like actually code files) to fine tune an llm on a codebase. There is a github project called your_devin from a hackathon, but it doesn't look complete. And I haven't been able to find anything else that comes close. Thanks for the reply 👍

    • @nasiksami2351
      @nasiksami2351 5 месяцев назад

      @@figs3284 I'm also looking for the same thing to generate synthetic data using LLM. Let me know if you find any resources.

  • @lhxperimental
    @lhxperimental 5 месяцев назад +2

    You should have shown what's in the input and what we have achieved by doing a before after example demonstrating the the improvement. We don't even know what happened and what was achieved.

    • @fahdmirza
      @fahdmirza  5 месяцев назад

      I am not sure what you are referring to here. The purpose of video is to show the process of how to do fine-tuning with this ai tool kit and that's very clear from start to finish.

    • @drmetroyt
      @drmetroyt 5 месяцев назад

      I think , he meant you should first ask the question to the LLM than train a model with your own dataset and then again ask the same question to the LLM and see if it gives same response as before or gives more refined response after fine tuning

    • @fahdmirza
      @fahdmirza  5 месяцев назад

      ​@@drmetroytthat was not the purpose of video. I have countless other videos showing that.