Qwen3.8 125B (6B active) Flash-Next
on AMD Strix Halo 128GB · Gufo · 262,144 ctx
Summary
User reports running Qwen3.8-Flash-Next UD-Q4_K_XL at 262K context on a Strix Halo 128GB (Ryzen AI Max+ 395) with a 96GB GPU carve-out, using Gufo (a Windows-port fork) with Unsloth Studio as client.
Setup uses a 64GB minimum / 192GB maximum page file and a source patch to Gufo's snapshot budget (set to 16GB via environment variable) to fix a Windows memory misread that capped the cache at ~264 MiB. Disk cache is off.
Performance is about 900 to 1,000 tok/s prompt processing and 35 to 55 tok/s decode depending on context length. First token at 120K+ tokens now arrives in 2 to 5 s instead of 40 s or more. User is happy with the setup.