How To FineTune Llama3
HTML-код
- Опубликовано: 10 сен 2024
- Follow Along: console.brev.d...
Join Our Discord: / discord
Request Access To the Model: huggingface.co...
In this guide, we fine tune the popular open sourced model, Llama3-8B using the powerful finetuning method DPO (Direct Preference Optimization). You can do this all from your laptop! Try it out and let us know what you think
Please leave any future guides you would like made below!
Why is your viewer pov lower? I think bit higher would be fine. Good going with your content. Keep them coming. ❤🎉
The chat template is not available for download anymore. Could you check please? Thanks.
hey there, looks like the user who created that formatter changed the name! We will update the notebook. To get it to work simply replace the word “chat” with “instruct” in the url, so
raw.githubusercontent.com/chujiezheng/chat_templates/main/chat_templates/llama-3-instruct.jinja
@@brev-dev Thanks!
This is goooood good stuff
Lebanon Gang
Here from TikTok 🫡
keep going bro thank you for this
you’re welcome - baxate
understood 0% but we gotta start somewhere ig
Does Brev also provide cloud storage similar to an aws s3 bucket ?
currently working on this feature! Be on the lookout for it soon
Lebanon
Can you try it using ORPO instead DPO?
you have to pay to deploy it?
Keep up the good work man 🫡
here from tiktok
thank you
171k
157k
you have to pay to deploy?
yes, because this is on an A100 GPU, you will have to purchase brev credits. However, this particular instance is a few dollars an hour so in total this guide should be about 4$