llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · Ignis · 512,000 ctx

Tone: positiveNVIDIA hardware
Oct 4, 2026
Throughput
200.0 t/s gen
Quant
NVFP4 (NVFP4)

Use cases

codingagenticlong-contextvision

Summary

User reports Qwen3.8-27B at ~200 tok/s single stream on one RTX 5090. Setup is Ignis with NVFP4 and DFlash2 speculative decoding (7 draft tokens), 512K context via YaRN x2, KV at 9 KB/token. Aggregate throughput is >800 tok/s with 8 lanes; image questions cost 60-90 ms each; locate found the right log line 21/23 times at median 2.6 s.