llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Gufo · 16,384 ctx

Tone: positiveAMD hardware
Oct 30, 2026
Throughput
35.0 t/s gen · 1888.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
System RAM
128 GB

Summary

User reports Qwen3.8-Flash-Next at 35.0 t/s short-context decode and 1888 t/s prefill on a Strix Halo 128GB (Ryzen AI Max+ 395) box. Setup is Gufo with UD-Q4_K_XL GGUF weights (103.69 GiB across four shards), GPU only, no MTP, FCLK locked at 2000 MHz, ROCm 7.2.3. At 16K context decode is 34.1 t/s. Stock llama.cpp ROCm HIP on the same machine gave around 568 t/s prefill and 23-24 t/s decode. The model is the ~125B MoE with ~6B active plus n-gram embedding and MTP modules, fitting in the 128 GB pool with about 117 GiB GTT reported.