Qwen3.8 125B (6B active) Flash-Next
on AMD Strix Halo 128GB · Gufo · 16,384 ctx
Summary
User reports Qwen3.8-Flash-Next at 35.0 t/s short-context decode on a Strix Halo 128GB (Ryzen AI Max+ 395, Radeon 8060S).
Setup is Gufo with UD-Q4_K_XL GGUF, GPU only, no MTP, 128 GB unified memory with about 117 GiB GTT and a 512 MiB BIOS VRAM reservation.
At 16K context prefill is 1888 t/s and decode 34.1 t/s. The 103.69 GiB model spans four GGUF shards and fits without issue.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Qwen3.8 125B · 6B active at 4-bit by hardware
- 129.2 t/s · one run
- 105.5 t/s · 6 runs
- 57.2 t/s · 2 runs
- 55.0 t/s · one run
- 36.7 t/s · one run
- NVIDIA DGX Spark128 GB29.8 t/s · 2 runs
Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Models most run on the AMD Strix Halo 128GB
- 26.6 t/s · 8 runs
- 60.0 t/s · 7 runs
- 69.9 t/s · 6 runs
- 50.4 t/s · 4 runs
- 52.6 t/s · 4 runs
- 71.7 t/s · 4 runs
Bars are medians on one scale, 0 to 77.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Everything reported on the AMD Strix Halo 128GB →Every Qwen3.8 report →Estimate Qwen3.8 on this card →