Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 5090 · Strata · 131,072 ctx
Summary
User reports Qwen3.8-Flash-Next at 146.5-152.5 t/s generation and 8,535 t/s prompt processing on an RTX 5090 32GB with 128GB RAM.
Setup is Strata with NVFP4 GPTQ 4-bit weights and 128K context; the model is a 125B-A6B MoE with speculative decoding and expert offload to RAM and SSD.
The figures are a range over three runs; an Unsloth UD-Q4_K_XL run on the same box gave 132.7-138.8 t/s generation and 6,255 t/s prompt processing. The post is a beginner guide and also cites official and community numbers for other hardware.