Qwen3.8 125B (6B active) Flash-Next
on AMD Strix Halo 128GB · strixite · 87,000 ctx
Summary
User reports Qwen3.8-Flash-Next at 90.2 t/s decode and 1375 t/s prefill on a Strix Halo 128GB at 87k tokens of context.
Setup is the strixite engine with cold, cache-defeated runs; the model is a hybrid recurrent/attention architecture whose KV cache is about 20 GiB at full depth.
Decode decays from 94.6 t/s at 21k to 90.0 t/s at 261k, a 10% cost across 50x the memory. The user retracted earlier 765k t/s prefill figures as prefix-cache hits and reports the box runs 176.9B parameters at full working depth.