Qwen3.8 125B (6B active) Flash-Next
on AMD RX 9070 XT 16GB · Strata · 292,000 ctx
Use cases
agenticlong-context
Summary
User reports Qwen3.8-Flash-Next at around 40 tokens/s on a single RX 9070 XT 16 GB, with experts partly held in 64 GB of system RAM and read from NVMe when not cached.
Setup is Strata 0.1.44.1 with Unsloth UD-IQ4_XS weights, INT8 KV cache and a 292,000-token context using YaRN; the RAM expert budget is 48 GiB and the engine memory limit 57 GiB.
Prompt processing is about 5,364 tokens/s but may reuse cached context, so it is not a cold-prefill figure. Thinking runs about 36.5 tokens/s and some runs reached about 51 tokens/s. A 49 GiB expert budget was OOM-killed on a roughly 161,000-token conversation.