Qwen3.8 27B
on NVIDIA RTX 5090 · vLLM · 65,536 ctx
Sep 7, 2026
Use cases
tool-usebusinessmath
Summary
User reports Qwen3.8 27B at 59 t/s single stream on an RTX 5090, with aggregate throughput above 100 t/s for two requests and 279 t/s with four parallel jobs.
Setup is vLLM 0.27.1 with the PrismaAqua 5.5-bit quant. The user also mentions the RTX 6000 Pro as target hardware.
Quality is close to BF16 on a custom suite. The user prefers medium reasoning over xhigh because of fewer token-cap failures.