Qwen3.5 35B (3B active)

User benchmarks Qwen3.5-35B-A3B (MoE, 35B total, ~3.5B active) at 149.2 t/s decode and 3075 t/s prefill on an AMD Radeon AI PRO R9700 32GB. Setup is llama.cpp (Vulkan, RADV driver) with UD-Q4_K_XL quant, flash attention on, ubatch 2048, and a one-line rm_kq=1 patch; single GPU. The figures are the best RADV configuration (rm_kq=1 + ub2048); stock RADV gives 147.8 t/s decode and 2381 t/s prefill. AMDVLK with rm_kq=1 reaches 156.3 t/s decode but only 1823 t/s prefill. WikiText-2 perplexity is 6.9472 ± 0.046 across all configurations.