llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 3× NVIDIA RTX 3090 · ExLlamaV3

Tone: positiveNVIDIA hardware
Sep 20, 2026
Throughput
110.0 t/s gen · 1500.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
3.05bpw (EXL3)
KV cache
FP16

Use cases

codingtool-use

Summary

User reports Qwen3.8 Flash Next at 110+ t/s generation and over 1,500 t/s prompt processing on 3x RTX 3090s. Setup is ExLlamaV3 with a 3.05 bpw EXL3 quant at full context and FP16 KV cache, with only the engram table offloaded to RAM. All three cards run at 250-265W and one is on a TB4 eGPU. User also ran Qwen3.8 27B (UD-Q8_K_L) on 2x 3090s in TP and a UD-Q4_K_XL of Qwen3.8 Flash Next that partially offloaded to RAM, reaching about 50 t/s max output, 38 t/s average, and prompt processing in the low hundreds.