Qwen3.8 125B (6B active) Flash-Next
on AMD RX 9060 XT 16GB · Strata · 65,536 ctx
Use cases
chat
Summary
User reports Qwen3.8-Flash-Next Q2_0 at 45.5 t/s decode and 161.9 t/s prefill (pp4k) on an RX 9060 XT 16GB with 32GB DDR4, but says prefill is usually under 150 t/s and asks how to fix it.
Setup is Strata 0.1.52 (HIP backend, Windows) with a 64K context and int8 KV cache; the 37.6 GB GGUF exceeds the card's VRAM, so weights run partly from system RAM.
Strata's tuner ran 501.5 s and confirmed the defaults; two tuning arms were skipped for lack of free memory (25.6 GiB free, 28.4 GiB needed).
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Qwen3.8 125B · 6B active at 4-bit by hardware
- 129.2 t/s · one run
- 105.5 t/s · 6 runs
- 57.2 t/s · 2 runs
- 55.0 t/s · one run
- 36.7 t/s · one run
- NVIDIA DGX Spark128 GB29.8 t/s · 2 runs
Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Models most run on the AMD RX 9060 XT 16GB
- Qwen2.5 14B4-bit33.5 t/s · one run
- Qwen3.8 27B3-bit30.0 t/s · one run
Bars are medians on one scale, 0 to 33.5 tokens/s. Press ▶ to watch text arrive at a row's speed.
Everything reported on the AMD RX 9060 XT 16GB →Every Qwen3.8 report →Estimate Qwen3.8 on this card →