llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · ignis · 8,192 ctx

NVIDIA hardware
Oct 27, 2026
Throughput
416.0 t/s gen
Quant
3-bit trellis

Use cases

codingagentic

Summary

User reports Qwen3.8-27B at 416 tok/s on a single RTX 5090 held to a 16 GiB budget, with 684 tok/s aggregate at two lanes. Setup is ignis with a 3-bit trellis body (13.4 GB) and the DFlash2 drafter, 8K context, greedy coding prompts. The 5090 figures stand in for 16 GB RTX 50 cards the author does not own; estimates for real cards are 243-307 tok/s on an RTX 5080, 204-270 tok/s on an RTX 5070 Ti and 103-153 tok/s on an RTX 5060 Ti 16 GB. The author also reports 262,144 tokens of context on two lanes and KL divergence from BF16 at 0.77-0.82x that of the 32 GB NVFP4 build.