llamaperf

Qwen3.6 35B (3B active)

on AMD Strix Halo 128GB · strix-llama.cpp

Tone: positiveAMD hardware
Oct 12, 2026
Throughput
56.3 t/s gen · 4045.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_0 (GGUF)
KV cache
q8_0
System RAM
128 GB

Summary

User benchmarks a new strix-llama.cpp branch (rdna35-perf) on a Strix Halo 128GB box, reporting prompt processing 21-54% faster than Vulkan and 8-174% faster than stock ROCm, with generation tying Vulkan on the dense 27B and 2-3% behind on MoE and 2B at short context. Setup is llama-bench with Q8_0 weights, q8_0 KV cache, flash attention on, ROCm/HIP backend, ub 4096 for the MoE. The headline Qwen3.6 35B-A3B figures are pp4096 4045 t/s and tg64 56.3 t/s at depth 0. Quality checks show KL divergence closer to stock ROCm than Vulkan and unchanged perplexity. The branch is ROCm/HIP only and was tested on three models: Qwen3.6 35B-A3B, Qwen3.8 27B, and Qwen3.5 2B.