Microsoft BitNet.cpp vs Llama.cpp : Run LLMs on CPU

This video compares BitNet.cpp and Llama.cpp, two major frameworks for running LLMs on CPu #ai #microsoft #generativeai #chatgpt #machinelearning

[@marcusk7855]

It'll be great when they implement the NPU version now all the CPU's are adding NPUs. Even the small ARM SBC's.

[@datascienceinyourpocket]

Yepp, agreed

[@dafnik8925]

Mate, thank you for the video! It's spot on! If you want more views, you have a very HEAVY accent even for an Indian and it's hard to understand, just run some AI voice.

[@datascienceinyourpocket]

Thanks buddy. Will consider this

[@dafnik8925]

@@datascienceinyourpocket I also don't have radio voice, I write perfect English, but don't speak perfectly... accent is hard to get rid off :)

[@datascienceinyourpocket]

Thanks for understanding, let me see a workaround for this. Still, thanks for the honest feedback

[@dafnik8925]

@@datascienceinyourpocket Try ElevenLabs, I once used it to clone the voice of a famous 80s singer for a modern mix of her songs :)