llamaperf
Oct 16, 2026
Throughput
82.0 t/s gen
Quant
Q6

Summary

User reports Qwen3.6 35B-A3B at 82 t/s decode on a 4x RTX 3090 rig with MTP disabled. Setup is a Q6 quant with MTP speculative decoding off; the same rig reached about 70 t/s with MTP enabled. The user attributes the gain to MTP's draft-and-verify step needing extra sync passes across the four layer-split GPUs, where PCIe hops cost more than the accepted draft tokens save.