llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Gufo · 16,384 ctx

AMD hardware
Oct 31, 2026
Throughput
35.0 t/s gen · 1888.0 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
UD-Q4_K_XL (GGUF)
System RAM
128 GB

Summary

User reports Qwen3.8-Flash-Next at 35.0 t/s short-context decode on a Strix Halo 128GB (Ryzen AI Max+ 395, Radeon 8060S). Setup is Gufo with UD-Q4_K_XL GGUF, GPU only, no MTP, 128 GB unified memory with about 117 GiB GTT and a 512 MiB BIOS VRAM reservation. At 16K context prefill is 1888 t/s and decode 34.1 t/s. The 103.69 GiB model spans four GGUF shards and fits without issue.

Compare this run

Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.

Qwen3.8 125B · 6B active at 4-bit by hardware

Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Models most run on the AMD Strix Halo 128GB

Bars are medians on one scale, 0 to 77.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Everything reported on the AMD Strix Halo 128GB →Every Qwen3.8 report →Estimate Qwen3.8 on this card →