Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 5090 · ExLlamaV3 · 262,144 ctx
Oct 9, 2026
Summary
User reports Qwen3.8-Flash-Next at 241.7 tok/s on code and 254.3 tok/s on prose on 2x RTX 5090.
Setup is ExLlamaV3 v1.5.0 with TabbyAPI, 2.50 bpw EXL3 quant, 8-bit KV cache, 262k context, MTP speculative decoding on, 2 cards.
Aggregate decode at 4 streams is 592 / 595 tok/s; prefill is 10,034 / 9,865 t/s at 86-172k-token prompts; peak decode power 302.8 W / 285.0 W per card.