llamaperf

Qwen3 32B

on AMD Radeon 8060S integrated GPU (Strix Halo; installed RAM unreported) · llama.cpp b5348 / 09232370 / ROCm rocWMMA

Oct 14, 2026
Throughput
6.4 t/s gen · 77.4 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_0 (GGUF)
Flash Attention
on

Summary

User reports Qwen3-32B at 6.4 t/s generation and 77.4 t/s prompt processing on a Ryzen AI Max+ 395 / Radeon 8060S under Linux. Setup is llama.cpp with ROCm, Q8_0, flash attention enabled, ngl 99, and one local gfx1151 device. The stored figures are rounded from native llama-bench results of 6.43 t/s TG128 and 77.43 t/s PP512; a second run at 8192 prompt tokens gave 75.68 t/s PP8192 and 6.42 t/s TG128.