Qwen3.6 35B (3B active)
on NVIDIA RTX 4080 · llama.cpp · 65,535 ctx
Sep 18, 2026
Summary
User reports Qwen3.6 35B A3B at 45 t/s on an RTX 4080 16GB, and Gemma 4 12B at 34 t/s.
Setup is llama.cpp with CUDA 13.3, MXFP4_MOE GGUF, 65535 context, q8_0 KV cache, and draft-MTP speculative decoding with n-max 4.
User finds MTP speculative decoding consistently reduces throughput rather than improving it, contrary to reports of 20-30% gains.