llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · NInfer

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
200.0 t/s gen
VRAM reported
32 GB

Summary

User reports Qwen3.8-27B at about 200 t/s generation on a single RTX 5090 with speculative decoding, on day-0 support in NInfer. The setup uses a shared paged KV cache and ReplaySSM for GDN, with PDL in use. The user notes support for up to 8 concurrent requests.