Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 5090 · Strata · 262,144 ctx
Use cases
codingvision
Summary
User reports Qwen3.8-Flash-Next 125B-A6B running a single-prompt Blender room-building challenge on an RTX 5090 32GB, with engine-verified decode median 121.4 t/s and mean prefill 2,757 t/s.
Setup is the strata-nvfp4 fork of Strata with self-converted NVFP4 experts plus Q8_0 dense weights, int8 KV cache, 262,144 max context, MTP draft head with spec 5, and 63 GiB of experts pinned in 192GB DDR5 system RAM.
The run took 26m 17s over 103 steps and 132,929 output tokens with 179 tool calls and no compactions, peaking at 194k context; TTFT was 0.85s median and 32.9s max, and the vision encoder ran on CPU.