Processing dataset for finetuning an LLM Model in Rust | Part-3

Поделиться
HTML-код
  • Опубликовано: 8 ноя 2024

Комментарии • 4

  • @dm4945
    @dm4945 8 месяцев назад +1

    Are you planning to do the fine tuning in rust or you r using rust only for preparing the dataset.

    • @buffetCodes
      @buffetCodes  8 месяцев назад

      Well, I'm definitely targeting keeping everything in Rust including the finetuning part. Touched upon this slightly in my blog here: krshrimali.github.io/posts/2024/02/building-a-chatbot-from-your-documentation-website-docsgpt/. I'm optimising about this approach to use the LibTorch equivalent bindings in Rust (tch-rs), let's see how it goes :)
      The "Why Rust" section in the link above might interest you as well. Thanks for watching the video and the comment btw.

    • @dm4945
      @dm4945 8 месяцев назад

      @@buffetCodes cool.

    • @MidSeasonGroup
      @MidSeasonGroup 7 месяцев назад

      Were you able to actually fine tune a usable model in Rust to that is can copilot codebases in rust. Many models just get confused with Rust.