llamaperf
Oct 12, 2026
Throughput
39.9 t/s gen · 1068.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_0
KV cache
Q8
Flash Attention
on
System RAM
128 GB

Summary

User reports Qwen3.6 35B-A3B at 39.9 t/s generation and 1068 t/s prompt processing on an AMD Strix Halo 128GB box with a Radeon 8060S. Setup is llama.cpp on the rdna35-perf ROCm/HIP branch with Q8_0 weights, q8_0 KV cache, Flash Attention on and microbatch 4096, measured with llama-bench. Both figures are separate benchmark cells at 128k tokens of cache depth, not one end-to-end request; the prompt test processes 4096 additional tokens at that depth, and configured context is unspecified.