Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 3080 10GB · Speedy · 200,000 ctx
Use cases
codingagentic
Summary
User reports Qwen3.8-Flash-Next on 2x RTX 3080 10GB with experts in system RAM, reaching 3,957 t/s prefill at a 200K cold prompt and decode of ~145-185 t/s with UD-IQ4_XS.
Setup is the Speedy fork of Strata with UD-IQ4_XS, a 200K-token cold prompt, two pipeline windows and speculative decoding; the box is a Threadripper PRO 5975WX with 128 GB DDR4-3200.
Decode varies with reply length and context, sitting at the top of the range for short replies and the bottom after a 200K prompt; a 200K cold prompt took 51 s. The 1x RTX 3080 table gives ~113-128 t/s decode and 1,792 t/s prefill at 200K for the same quant.