llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · vLLM · 196,000 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
120.0 t/s gen
Quant
NVFP4
VRAM reported
32 GB

Use cases

coding

Summary

User reports an average of 120 t/s across 3 parallel sessions. Setup is a 451K global KV cache with vision enabled and power limited to 400W. Detailed benchmarks are given in a table.