Qwen3.8 27B
on NVIDIA RTX 5090 · ignis · 8,192 ctx
Use cases
codingagentic
Summary
User reports Qwen3.8-27B at 416 tok/s on a single RTX 5090 held to a 16 GiB budget, with 684 tok/s aggregate at two lanes.
Setup is ignis with a 3-bit trellis body (13.4 GB) and the DFlash2 drafter, 8K context, greedy coding prompts.
The 5090 figures stand in for 16 GB RTX 50 cards the author does not own; estimates for real cards are 243-307 tok/s on an RTX 5080, 204-270 tok/s on an RTX 5070 Ti and 103-153 tok/s on an RTX 5060 Ti 16 GB. The author also reports 262,144 tokens of context on two lanes and KL divergence from BF16 at 0.77-0.82x that of the 32 GB NVFP4 build.