llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · llama.cpp

Tone: positiveNVIDIA hardware
Oct 5, 2026
Throughput
148.0 t/s gen
Quant
NVFP4 (NVFP4)
System RAM
64 GB
VRAM reported
32 GB

Use cases

codingsummarizationtool-useagenticlong-context

Summary

User reports Qwen3.8 27B at roughly 148 tok/s on an RTX 5090 with MTP enabled. Setup is llama.cpp with NVFP4 weights and MTP speculative decoding on a single 32GB card. Without MTP the same model ran at about 72 tok/s, and a Q4_K_M build at about 70 tok/s. Other models tested: GPT-OSS 20B MXFP4 at about 311 tok/s, Qwen3.6 hybrid at about 250 tok/s, Gemma 31B QAT at about 68 tok/s, and Flash Next at about 199 tok/s.