Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 4090 · Strata · 262,144 ctx
Use cases
codingtool-uselong-context
Summary
User reports Qwen3.8-Flash-Next at 87-98 t/s decode on short prompts on a single RTX 4090 24GB, after moving from 32GB to 64GB of DDR5-5800.
Setup is Strata 0.1.45 with Unsloth UD-IQ4_XS (about 55GiB of experts), 262K native context, q4_0 KV cache and MTP drafts at spec 4. 40.00 GiB of experts sit in RAM with no blob reads from the SATA SSD, leaving about 11GB free.
A 36K-token needle test gave 2,000 t/s prompt and 94 t/s decode; a 136K-token test gave 2,850 t/s prompt and 92 t/s decode. Expert cache hit rate is about 91%. The user notes IQ2_XS ran 140-160 t/s and IQ3_S 110-126 t/s on the same card, so the 4-bit move cost speed. Strata's quant table puts UD-IQ4_XS at 88.9% top-token match with Q8_0.