Qwen3 32B
on AMD Strix Halo 128GB · llama.cpp 1d49ca3 (author-reported) / Vulkan RADV
Summary
User reports Qwen3-32B-Q8_0 at 6.4 t/s generation and 84.9 t/s prompt processing on an AMD Strix Halo 128GB system.
Setup is llama.cpp with the Vulkan (RADV) backend, FA 1 and ngl 99, on a single AMD Radeon Graphics (RADV GFX1151) device.
The figures come from separate llama-bench phases: PP512 at 84.87 +/- 0.35 t/s and TG128 at 6.43 +/- 0.01 t/s. Context depth, thread count and KV cache type are unreported.