Qwen3.6 35B (3B active)
on Intel Arc B580 12GB · llama.cpp · 200,000 ctx
Oct 6, 2026
Summary
User reports a 35B-A3B MoE model (3B active) at 47-50 t/s decode and 160-200K context on a single Intel Arc B580 12 GB.
Setup is llama.cpp SYCL with IQ2_XXS mixed quant, MoE experts offloaded to CPU via --n-cpu-moe 24, -ub 1024 -b 2048, -fa on, on Windows 11 with a Ryzen 5 9600X and 32 GB DDR5-6000.
Decode drops to 43.0 t/s at 43.5K context; prefill at 43.5K is 638-867 t/s depending on quant and n-cpu-moe. A 65K context sweet spot with --n-cpu-moe 8 reaches 63 t/s. The same recipe applies across the Gated-DeltaNet MoE family, including Qwen3.6-35B-A3B, Occamy-1.0, Qwen3.8-35B-Distill and Ornith-1.5-35B-A3B.