Four Ways to Check if Ollama is Using Your GPU or CPU

[@zandanshah]

Thanks, keep the good work going.

[@TigerTriangleTech]

Thanks, will do!

[@igoriane93]

In my specific case (7900XT) it tries to locate ROCm0, as Iam using windows my computer freezes.

[@vmeow9895]

why after a while, the response_token/s gradually decreases?
i use rx 6600xt

[@TigerTriangleTech]

Hello and thanks for watching. I'm not sure, but in a chat situation, I would think it could be because it is storing previous prompts in memory in order to "remember" the previous conversations. How much it keeps could depend on the context window of the model. I have not tested this but that's my best guess. Someone else may have a better answer.

[@vmeow9895]

@@TigerTriangleTech Thanks for your reply to my question, Hope you can solve it later😁