Qwen3.6 35B (3B active)
on RTX 2060 6GB · ik_llama.cpp · 15,000 ctx
Summary
User reports roughly 23 t/s for Qwen3.6-35B-A3B UD-Q4_K_M on an RTX 2060 6GB with default ik_llama.cpp, and around 26-30 t/s with their own fork's expert-residency changes.
Setup is a single RTX 2060 6GB with a Ryzen 7 2700X and 40GB DDR4, Q4_K_M weights with all experts on the CPU (-cmoe), at around 15-30k context.
The fork adds bandwidth-adaptive CPU/GPU execution and a resident expert cache in spare VRAM (--moe-resident auto --moe-resident-mib), giving the user roughly a 20-30% speedup.