llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Halowin Bubo · 262,144 ctx

Tone: positiveAMD hardware
Oct 30, 2026
Throughput
54-79 t/s gen · 1556.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
System RAM
128 GB
VRAM reported
96 GB

Summary

User reports Qwen3.8 Flash-Next at 1,556 tok/s prefill on a Geekom A9 Mega (Ryzen AI Max+ 395, 128 GB LPDDR5X), with decode swinging 54-79 tok/s as draft acceptance varies between 53% and 80%. Setup is Halowin Bubo, a Gufo fork for Windows 11 and Strix Halo, running the UD-Q4_K_XL GGUF at 108.6 GiB across 8 files, with 96 GB carved out to the GPU in BIOS and a fixed 128 GB page file. Context window is 262K. User says it does not slow down over long context; a 20.3M-token session at a 98% cache hit never pushed the live window past 73%. Load takes 24-26 s. The engine is three weeks old, Windows-only by design, and the user is not affiliated with its authors.