Qwen3.6 35B (3B active)
on AMD Radeon AI PRO R9700 32GB · llama.cpp · 262,144 ctx
Aug 28, 2026
Use cases
codingtool-useagentic
Summary
User reports Qwen3.6-35B-A3B at 84.48 tokens per second generation and 2000.37 tokens per second prompt eval on a Radeon 9700 with 32GB VRAM.
Setup is llama.cpp on Vulkan with the UD-Q5_K_M GGUF, -ngl 99, 262144 context, q8_0 KV cache, flash attention on, batch and ubatch size 2048, 8 threads and parallel 1.
With MTP, which the user is now testing, generation is around 110 - 130 t/s and prefill drops to 1700 t/s. ROCm gave much faster prefill but slower generation.