Qwen3.8 125B (6B active) Flash-Next
on AMD RX 7900 XTX · Strata · 262,144 ctx
Use cases
agenticlong-context
Summary
User reports Qwen3.8-Flash-Next at 86 tok/s median decode and ~3.1k tok/s median prefill on a single RX 7900 XTX 24GB.
Setup is Strata with IQ3_S weights and an oct3 3-bit KV cache, 4-token MTP speculative decoding, full 262K context resident on the card.
Figures come from 8.7k real requests in the engine log, not a synthetic benchmark; decode reaches 107 tok/s at p90 and 154 peak, prefill up to 3.6k, and a 250K-token prompt is read in ~80 s. The user says oct3 shows no noticeable quality drop versus k8v4 in agentic use.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Qwen3.8 125B · 6B active at 4-bit by hardware
- 129.2 t/s · one run
- 105.5 t/s · 6 runs
- 57.2 t/s · 2 runs
- 55.0 t/s · one run
- 36.7 t/s · one run
- NVIDIA DGX Spark128 GB29.8 t/s · 2 runs
Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Models most run on the AMD RX 7900 XTX
- Qwen3.8 27B4-bit40.0 t/s · 7 runs
- 142.8 t/s · one run
- Gemma 4 31B4-bit30.1 t/s · one run
- Gemma 4 8B16-bit58.0 t/s · one run
- 125.5 t/s · one run
Bars are medians on one scale, 0 to 142.8 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Everything reported on the AMD RX 7900 XTX →Every Qwen3.8 report →Estimate Qwen3.8 on this card →