Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 5090 · Basalt · 64,000 ctx
Summary
User reports Qwen3.8 Flash-Next at 665 tok/s structured and 354 tok/s prose on an RTX 5090 + RTX 5060 Ti.
Setup is Basalt, a Strata fork for Blackwell, with IQ3_XXS weights, 64k context, MTP enabled, 400 W, on a 9950X with 32GB DDR5 RAM.
A single 5090 gives 585 struct and 316 prose, about 12% slower, with prefill unchanged. Concurrency of 8 streams totals 623 tok/s. IQ3_S prose is 300 tok/s at ~89% top-1 agreement.