llamaperf

Qwen3.6 27B Heretic-v2

on NVIDIA RTX 4090 · llama.cpp · 262,000 ctx

Tone: positiveNVIDIA hardware
May 9, 2026
Throughput
80.0 t/s gen
Quant
Q4_K_M (GGUF)
KV cache
Q4
VRAM reported
24 GB

Summary

User reports MTP draft acceptance of about 73%. Setup is a TBQ4_0 KV cache with an MTP draft of 3, using a fork of llama.cpp.