Qwen2.5 7B Coder
on Unknown GPU · Ollama
Use cases
coding
Summary
User runs Qwen2.5-Coder 7B and Qwen3 8B with Ollama in an LXC container on Proxmox, entirely on the CPU (Intel i5-12400, 32GB DDR4, no dedicated GPU), getting around 7-8 tokens per second.
Setup is Ollama with no GPU, 18GB RAM allocated to the container, used for programming via the Continue extension in VS Code.
User asks which GPU to buy for this machine; the 7-8 t/s is a range and no GPU was used for the reported run.