llamaperf

Qwen3.6 27B

on NVIDIA RTX 3090 · llama.cpp · 100,000 ctx

Tone: mixedNVIDIA hardware
Aug 28, 2026
Throughput
42.0 t/s gen · 1020.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
VRAM reported
24 GB

Use cases

codingagentic

Summary

User reports MTP improves generation speed by 42% but reduces prompt processing by 18%. MTP requires at least 2GB free VRAM. Without MTP the run reaches 1020/42 t/s; with MTP it reaches 830/60 t/s.