Qwen2.5 7B

User reports Qwen2.5 7B Instruct at 49.0 tok/s on an RTX 3060 12GB, and 6.4 tok/s CPU-only on the same machine. Setup is Ollama 0.11.4 with Q4_K_M weights, single-stream, warm speed as the median of three runs with 200-token answers. About 1.2 GB of the card was already in use by the desktop and a Stable Diffusion web UI. The same model measured 48.9 tok/s on the GPU in a separate CPU-vs-GPU comparison, with a cold first answer of 5.6 s on GPU against 31.3 s CPU-only, a 7.6x speed-up. The user notes the CPU is a 2012 Xeon E5-2665 without AVX2, and that a modern CPU with AVX2 or AVX-512 will beat these CPU numbers.