Qwen3.8 27B
on NVIDIA RTX 5090 · NInfer
Sep 7, 2026
Summary
User reports Qwen3.8-27B at about 200 t/s generation on a single RTX 5090 with speculative decoding, on day-0 support in NInfer.
The setup uses a shared paged KV cache and ReplaySSM for GDN, with PDL in use.
The user notes support for up to 8 concurrent requests.