llamaperf

Qwen3.8 27B

on NVIDIA RTX 4090 · llama.cpp · 242,760 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
90.0 t/s gen
Quant
IQ4_XS (GGUF)
KV cache
Q8
VRAM reported
24 GB

Summary

User reports 90 t/s with MTP enabled and 45-50 t/s without MTP at full context. Setup uses a Q8 KV cache. User sees no difference versus FP16 and prefers speed over context.