How to Use Intel and AMD GPUs to run LLMs on Your PC

A new version of LM Studio allows you to use Intel and AMD GPUs to run open source LLMs locally on your PC!
I have an Intel Arc A770 with 16GB of VRAM on my Windows 11 PC. In this video I show how to use LM Studio v0.2.31 to select your Intel or AMD GPU, how to configure settings, how to choose an open source model you already downloaded, and how to prompt it. I compare speed tests with using only my AMD 3900X CPU.
LM Studio - lmstudio.ai/

[@saiadityagarlapati5579]

Great stuff. keep it going!!

[@ericalanwhitney]

awesome stuff! thanks for sharing!