llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · vLLM · 65,536 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
59.0 t/s gen
Quant
5.5-bit (compressed-tensors)
KV cache
fp8
VRAM reported
32 GB

Use cases

tool-usebusinessmath

Summary

User reports Qwen3.8 27B at 59 t/s single stream on an RTX 5090, with aggregate throughput above 100 t/s for two requests and 279 t/s with four parallel jobs. Setup is vLLM 0.27.1 with the PrismaAqua 5.5-bit quant. The user also mentions the RTX 6000 Pro as target hardware. Quality is close to BF16 on a custom suite. The user prefers medium reasoning over xhigh because of fewer token-cap failures.