llamaperf

Qwen 3.6-35B-A3B Q6dense / Gufo AR / 4081 cached + 2053 new / 128 out

on AMD Strix Halo 128GB · Gufo 594a6239 + dirty Qwen36 model change / ROCm HIP 7.2.3 · 133,760 ctx

AMD hardware
Oct 14, 2026
Throughput
68.4 t/s gen · 3095.4 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q6dense mixed Q6_K / UD-Q4_K_XL / Q8_0 (GGUF)
MTP (Multi-Token Prediction)
off
System RAM
128 GB

Summary

User reports Qwen3.6-35B-A3B-Q6dense at 68.4 t/s generation and 3095.4 t/s prompt processing on an AMD Strix Halo 128GB machine. Setup is Gufo with Q6dense mixed Q6_K / UD-Q4_K_XL / Q8_0 weights, F16 K/V for prefill and an 8-bit copy for decode, single-user capacity 133760. The headline run is AR at nominal depth 4096 with 4081 cached prefix tokens and 2053 new prefill tokens, output 128; the user notes one warmed sample per point with no error bars.