Qwen3.8 125B (6B active) Flash-Next
on 4× NVIDIA RTX 5060 Ti 16GB · Strata · 524,000 ctx
Oct 4, 2026
Use cases
agentic
Summary
User reports Qwen3.8-Flash-Next at 94-99 t/s sustained decode on 4x RTX 5060 Ti 16GB, with short turns reaching ~110 t/s.
Setup is a custom Strata fork (1 main + 3 expert tiers) with UD-Q4_K_XL quant, 524k context via ported rope-scaling, and a draft vocab fix. Prefill measured at 2159 t/s at 16k and 2420 t/s at 220k; 312k warm replay in 12ms.
User abandoned the setup because the Q4_K_XL quant loops in agentic use, repeating thoughts and re-firing tool calls, unlike their int4 W4A16 lane. They compare it favorably to their vLLM lane (~40 t/s at 455k with batch 4) but say the quality bar is not met for daily driving.