llamaperf

Qwen3.8 27B

on NVIDIA RTX 4080 · llama.cpp · 140,000 ctx

NVIDIA hardware
Sep 7, 2026
Throughput
19.0 t/s gen
Quant
IQ4_XS (GGUF)
KV cache
kvarn4
MTP (Multi-Token Prediction)
on
System RAM
64 GB
VRAM reported
16 GB

Summary

User reports 8 t/s without MTP, 14 t/s with MTP, and about 19 t/s with full optimizations. Setup is beellama 0.4.3, a llama.cpp fork.