llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Gufo · 16,384 ctx

Tone: positiveAMD hardware
Oct 12, 2026
Throughput
1821.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-IQ4_XS (GGUF)
System RAM
128 GB

Summary

User reports Qwen3.8 Flash-Next prefill at 1821 tok/s at 16k context on a Strix Halo 128GB (EVO-X2, Ryzen AI Max+ 395). Setup is a fork of Gufo with UD-IQ4_XS quant, offloading some GEMMs to the NPU while the GPU handles the rest. Output verified identical to GPU-only build across 30 long greedy prompts. Prefill improved from ~1700 tok/s with GPU only. Pinning the GPU fabric clock at max was required to avoid hard hangs and also gave a speedup by itself.