QLoRA: Efficient Finetuning of Quantized LLMs | Tim Dettmers
HTML-код
- Опубликовано: 12 окт 2023
- Tim Dettmers is a PhD Student, University of Washington
The Applied Machine Learning Days channel features talks and performances from the Applied Machine Learning Days held at the EPFL.
AMLD is one of the largest machine learning & AI events in Europe, focused specifically on the applications of machine learning and AI, making it particularly interesting to industry and academia.
Follow AMLD:
on Twitter: / appliedmldays
on LinkedIn: / appl. .
on Mastodon : mastodon.social/@amld
AMLD Website: www.appliedmldays.org Наука
Tim, you are amazing and you are doing such amazing work. Thank you for your contributions and all the hard work you do. QLoRA is nothing short of genius. I've found it a very effective regularization tool as well and it appears to improve generalization in protein language models like ESM-2. Again, thank you for all the incredible work you do. You're awesome!