Qwen3.8 125B (6B active) Flash-Next
on AMD Strix Halo 128GB · Halogen · 262,000 ctx
Use cases
codingagenticlong-context
Summary
User reports Qwen3.8 Flash-Next 125B MoE decoding at 64 tok/s and prefilling ~1,500 tok/s on a Strix Halo tablet, with the NPU handling search, dup scan, decisions and screening.
Setup is the Halogen engine with 262k context, fully local; the GPU still does the thinking and the NPU changed what tokens got spent on, at ~7% iGPU cost when they overlap.
First token lands in ~0.03s, about 43x faster than a cloud call measured side by side and still 7x with a second agent hammering the server; a 194k session compacted in ~50s versus 166 on the main model with 97% cache hit.