llamaperf

Qwen2.5 1.5B Coder

on RX 580 8GB · llama.cpp

Tone: positive
Oct 6, 2026
Throughput
99.2 t/s gen
System RAM
32 GB
VRAM reported
8 GB

Use cases

codingvisionagentictool-use

Summary

User reports qwen2.5-coder-1.5b at 99.2 tok/s on an RX 580 8GB. Setup is llama.cpp with Vulkan (Mesa RADV) backend, temp 0, max_tokens 300, on a Ryzen 5 5600G with 32 GB RAM. Other models measured: qwen2.5-vl-3b 66.4 tok/s, qwen2.5-7b 34.2 tok/s, ornith-1.5-9b 28.0 tok/s, qwen3-30b-a3b 21.3 tok/s (18.6 GB, from RAM). Forcing -ngl 99 on the MoE cost 8.1 vs 22.3 tok/s with auto-fit layers. Model swap takes 7.9-38.5 s. Agent first message ~161 s on a 20k-token prompt, ~25 s after caching.