llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · NInfer

NVIDIA hardware
Sep 7, 2026
Throughput
169.7 t/s gen
KV cache
Q8

Use cases

coding

Summary

User reports median decode speeds by context size on an unspecified setup: 169.7 t/s under 50k, 167.6 t/s at 50-100k, 156.9 t/s at 100-150k, 149.0 t/s at 150-200k, and 143.7 t/s at 200k and above. Context length is set to maximum. Peak decode for a single request is 222.0 t/s, with 211.2 t/s sustained over 5s.