llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · SGLang · 175,064 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
144.0 t/s gen
Quant
NVFP4 (safetensors)
KV cache
FP8
VRAM reported
32 GB

Summary

User reports prose decode at ~144 t/s and code at ~256 t/s, with parallel x2 at ~261/451 t/s. Prefill TTFT runs from 0.33s at 5k to 23.46s at 150k, with a 175k KV pool and a host-RAM KV tier that resumes a ~100k conversation in ~1s. External evals give GPQA Diamond 84.8%, GSM8K 96.8%, MATH-500 95.6%, AIME 2024 83.3%, HumanEval 56.7% and MBPP 75.0%. The run uses the froggeric template with xhigh reasoning and a 16k think cap.