llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Gufo + NPU (mikealanni fork)

AMD hardware
Oct 11, 2026
Throughput
1821.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-IQ4_XS (GGUF)
System RAM
128 GB

Summary

User reports Qwen3.8 Flash-Next at 1821 t/s prompt processing on an AMD Strix Halo 128GB host (GMKtec EVO-X2, Ryzen AI Max+ 395 / Radeon 8060S plus XDNA2 NPU). Setup is the gufo NPU-enabled fork with UD-IQ4_XS weights, 8192-token prefill chunks, GPU fabric clock held at its top level and NPU performance mode. The figure is a warmed synthetic-prefill microbenchmark at 16,384-token prefill length, not configured context capacity, and no generation throughput is published. The matched GPU-only baseline is 1698 t/s, a source-reported 7.2% improvement.