llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Gufo · 262,144 ctx

Tone: positiveAMD hardware
Oct 8, 2026
Throughput
35-55 t/s gen · 900-1000 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
System RAM
128 GB
VRAM reported
96 GB

Summary

User reports running Qwen3.8-Flash-Next UD-Q4_K_XL at 262K context on a Strix Halo 128GB (Ryzen AI Max+ 395) with a 96GB GPU carve-out, using Gufo (a Windows-port fork) with Unsloth Studio as client. Setup uses a 64GB minimum / 192GB maximum page file and a source patch to Gufo's snapshot budget (set to 16GB via environment variable) to fix a Windows memory misread that capped the cache at ~264 MiB. Disk cache is off. Performance is about 900 to 1,000 tok/s prompt processing and 35 to 55 tok/s decode depending on context length. First token at 120K+ tokens now arrives in 2 to 5 s instead of 40 s or more. User is happy with the setup.