llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 5080 · llama.cpp · 131,072 ctx

NVIDIA hardware
May 20, 2026
Throughput
56.0 t/s gen · 1584.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_XL (GGUF)
KV cache
Q8
Flash Attention
on
MTP (Multi-Token Prediction)
off
System RAM
128 GB
VRAM reported
16 GB

Use cases

codingagentic

Summary

User reports a 35B Q4_K_XL model at 128k context runs best with no MTP and --fit-target 1536. MTP does not help at 128k context. A 27B IQ3 model fits fully on GPU and benefits from MTP at 73 tok/s.