llamaperf

Qwen2.5 7B Coder

on Unknown GPU · Ollama

Oct 14, 2026
Throughput
7-8 t/s gen
System RAM
32 GB

Use cases

coding

Summary

User runs Qwen2.5-Coder 7B and Qwen3 8B with Ollama in an LXC container on Proxmox, entirely on the CPU (Intel i5-12400, 32GB DDR4, no dedicated GPU), getting around 7-8 tokens per second. Setup is Ollama with no GPU, 18GB RAM allocated to the container, used for programming via the Continue extension in VS Code. User asks which GPU to buy for this machine; the 7-8 t/s is a range and no GPU was used for the reported run.