Qwen3.6 35B (3B active)
on NVIDIA RTX 3070 · llama.cpp · 128,000 ctx
May 1, 2026
Summary
User reports Qwen3.6-35B-A3B at about 30 t/s with Q5_K_S at 128k context on an RTX 3070 8GB with 64GB DDR4.
Setup is llama.cpp. Q4_K_XL reached 32 t/s, and IQ4_XS gave 25-30 t/s at 32k context.
The user found that larger quants (Q4_K_XL, Q5_K_S) gave better speed than the smaller Q4 (IQ4_XS).