Qwen3.8 125B (6B active) Flash-Next
on 3× NVIDIA RTX 3090 · ExLlamaV3
Sep 20, 2026
Use cases
codingtool-use
Summary
User reports Qwen3.8 Flash Next at 110+ t/s generation and over 1,500 t/s prompt processing on 3x RTX 3090s.
Setup is ExLlamaV3 with a 3.05 bpw EXL3 quant at full context and FP16 KV cache, with only the engram table offloaded to RAM. All three cards run at 250-265W and one is on a TB4 eGPU.
User also ran Qwen3.8 27B (UD-Q8_K_L) on 2x 3090s in TP and a UD-Q4_K_XL of Qwen3.8 Flash Next that partially offloaded to RAM, reaching about 50 t/s max output, 38 t/s average, and prompt processing in the low hundreds.