llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 4080 · llama.cpp · 65,535 ctx

Tone: mixedNVIDIA hardware
Sep 18, 2026
Throughput
45.0 t/s gen
Quant
MXFP4_MOE (GGUF)
KV cache
q8_0
Flash Attention
on
VRAM reported
16 GB

Summary

User reports Qwen3.6 35B A3B at 45 t/s on an RTX 4080 16GB, and Gemma 4 12B at 34 t/s. Setup is llama.cpp with CUDA 13.3, MXFP4_MOE GGUF, 65535 context, q8_0 KV cache, and draft-MTP speculative decoding with n-max 4. User finds MTP speculative decoding consistently reduces throughput rather than improving it, contrary to reports of 20-30% gains.