Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 5090 · Strata · 4,096 ctx
Summary
User benchmarks Qwen3.8-Flash-Next on an RTX 5090 32 GB, reporting 155.3 t/s decode at 4K context with the Strata NVFP4 stack and 134.0 t/s with Infernix Dense8.
Setup is Strata 0.1.42-nvfp4.2 with an NVFP4/GPTQ pack, int8 KV cache, MTP speculative decoding (--spec 6), 15 CPU expert workers and 128 GB DDR5 at 6000 MT/s; one request at a time, 256 output tokens, greedy sampling.
At 32K Strata gives 154.7 t/s and Infernix 144.2 t/s; at 128K Infernix is faster at 147.3 t/s against 142.1 t/s. Infernix answers sooner (1.02 s vs 1.42 s at 4K). A retained Unsloth UD-Q4_K_XL run on the same Strata binary reached 130.5 t/s at 4K. The user notes the three stacks use different model representations and that this is not an intelligence ranking.