Qwen3.8 125B (6B active) Flash-Next
on AMD Strix Halo 128GB · Gufo · 8,192 ctx
Summary
User reports Qwen3.8 Flash-Next prefill at 2,013 tok/s on a Ryzen AI MAX+ 395 (Strix Halo 128GB) using the Gufo engine with UD-IQ4_XS quant.
Setup uses GPU + XDNA2 NPU prefill fork, with MTP and caches on for the served 42k cold run at 1,836 tok/s.
Prefill scales from 1,837 tok/s GPU-only to 2,013 tok/s with NPU at 8,192 tokens, and from 1,788 to 1,949 tok/s at 32,768 tokens.