Qwen3.8 27B
on NVIDIA RTX 5090 · NInfer
Sep 7, 2026
Use cases
coding
Summary
User reports median decode speeds by context size on an unspecified setup: 169.7 t/s under 50k, 167.6 t/s at 50-100k, 156.9 t/s at 100-150k, 149.0 t/s at 150-200k, and 143.7 t/s at 200k and above.
Context length is set to maximum.
Peak decode for a single request is 222.0 t/s, with 211.2 t/s sustained over 5s.