Qwen3.6 35B (3B active)
AMD RX 9070 XT 16GB · ExLlamaV3 · 128,000 ctx
- generation:
- 71.6 tokens/s
- prompt processing (prefill):
- 1246.0 tokens/s
- quant:
- EXL3 4.0 bpw (EXL3)
- kv:
- Q8
User benchmarks MoE expert offloading on an RX 9070 XT 16GB with 32GB DDR4, reporting Qwen3.6-35B-A3B at 71.6 t/s decode and 1246 t/s prefill at 128K context. Setup is ExLlamaV3 with EXL3 4.0 bpw and Q8 KV cache, DFlash2 with 2 drafts, experts offloaded to system RAM. Prefill drops from 1900 t/s at 16K to 700 t/s at 128K on the 35B models. Ornith 1.5 35B-A3B reached 57.3 t/s decode and 1168 t/s prefill at 128K, and Qwen3.8-Flash-Next Coder on Polystrata with IQ1_M reached 44.0 t/s decode and 1572 t/s prefill at 128K.