llamaperf

Qwen2.5 7B

on RX 580 8GB · llama.cpp

Tone: positive
Oct 6, 2026
Throughput
34.2 t/s gen
System RAM
32 GB
VRAM reported
8 GB

Use cases

codingvisionagentic

Summary

User reports qwen2.5-7b at 34.2 tok/s on an RX 580 2048SP, part of a six-model OpenAI-compatible stack running on Mesa RADV Vulkan. Setup is llama.cpp with a model-swapping router; the 30B-A3B MoE ran 18.6 GB from system RAM at 21.3 tok/s, and forcing -ngl 99 dropped it to 8.1 tok/s versus 22.3 tok/s with auto-fit layers. Other models measured: qwen2.5-coder-1.5b 99.2 tok/s, qwen2.5-vl-3b 66.4 tok/s, ornith-1.5-9b 28.0 tok/s. Model swaps take 7.9-38.5 s; SD 1.5 renders in 27.5 s and SD 3.5 Medium in 53.3 s per 512x512.