Qwen3.8 125B (6B active) Flash-Next
on AMD RX 7800 XT 16GB · Strata · 41,709 ctx
Use cases
coding
Summary
User reports Qwen3.8-Flash-Next at 64.9 tok/s aggregate decode and 985.8 tok/s prefill on an RX 7800 XT 16GB.
Setup is Strata 0.1.42 with IQ3_XXS and int8 KV cache, 39.97 GiB of expert weights in host RAM and 5,048 experts (8.19 GiB) cached in VRAM. MTP was enabled with --spec 4.
The 64.9 tok/s is aggregate decode over 54 requests; median per-request was 66.4 tok/s with a 56.1-82.8 tok/s range. Other fresh-prompt prefill readings were 912.9 tok/s at 6,731 tokens, 1,004.6 tok/s at 76,599 tokens, 791.0 tok/s at 116,392 tokens and 509.8 tok/s at 38,790 tokens. Across all 61 tail-skip requests aggregate decode was 52.7 tok/s. An informal comparison gave 50.8 tok/s without route tail skip and 56.7 tok/s with it.