I run a local model on a laptop with 16 GB of memory and an integrated GPU. When I ask it anything long, the fan goes up and the whole machine slows down for the rest of the session.
The model is a 7B at Q4, and ollama ps shows the model is split between the GPU and the CPU. I assumed "on the GPU" would mean "the GPU is doing the work". What is actually happening, and what should I do about it?