Well, I'm definitely targeting keeping everything in Rust including the finetuning part. Touched upon this slightly in my blog here: krshrimali.github.io/posts/2024/02/building-a-chatbot-from-your-documentation-website-docsgpt/. I'm optimising about this approach to use the LibTorch equivalent bindings in Rust (tch-rs), let's see how it goes :) The "Why Rust" section in the link above might interest you as well. Thanks for watching the video and the comment btw.
Are you planning to do the fine tuning in rust or you r using rust only for preparing the dataset.
Well, I'm definitely targeting keeping everything in Rust including the finetuning part. Touched upon this slightly in my blog here: krshrimali.github.io/posts/2024/02/building-a-chatbot-from-your-documentation-website-docsgpt/. I'm optimising about this approach to use the LibTorch equivalent bindings in Rust (tch-rs), let's see how it goes :)
The "Why Rust" section in the link above might interest you as well. Thanks for watching the video and the comment btw.
@@buffetCodes cool.
Were you able to actually fine tune a usable model in Rust to that is can copilot codebases in rust. Many models just get confused with Rust.