llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 5090 · llama.cpp

Tone: mixedNVIDIA hardware
May 7, 2026
Throughput
215.1 t/s gen
Quant
Q4 (GGUF)
VRAM reported
32 GB

Summary

User reports a 6% speed increase from MTP on a grafted model at Q4 on an RTX 5090. User also tests Q8 on an RTX 5090 plus an RTX 3090, reaching 148.20 t/s without MTP and 152.02 t/s with MTP.