llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · llama.cpp · 131,072 ctx

NVIDIA hardware
Oct 12, 2026
Throughput
701.2 t/s gen
Quant
UD-Q4_K_XL (GGUF)
KV cache
Q8
Flash Attention
on
MTP (Multi-Token Prediction)
on

Use cases

coding

Summary

User reports Qwen3.8 27B at 701.2 t/s on one NVIDIA RTX 5090, the median of three repeats (695.3, 709.0, 701.2) for a copy/edit task from a 27,135-token prompt with 400 completion tokens. Setup is llama.cpp b11060 CUDA with UD-Q4_K_XL, q8_0 key and value cache, Flash Attention, greedy sampling, and draft-mtp plus ngram-mod speculation with draft maximum 16 and n-gram range 96-192. The 131,072-token context is the server limit, not the measured prompt length, and the figure is not general chat or novel-code speed. At 3,038 prompt tokens the same profile returned a 784.1 t/s median (range 768.0-814.3).