Qwen3.8 125B (6B active) Flash-Next
on AMD Strix Halo 128GB · hipfire · 16,384 ctx
Summary
User reports Qwen3.8-Flash-Next at 2,372 tok/s prefill on a 16K prompt and 51.3 tok/s decode at 8K context on Strix Halo 128GB.
Setup is the hipfire 0.4.2.1 engine with MTP speculative decoding on, the XDNA2 NPU handling trunk input projections for two prefill banks alongside the iGPU.
Prefill falls to 1,865 tok/s at 128K cold and 1,589 tok/s at 256K cold; decode is 41.8 tok/s at 32K, 42.1 at 128K and 35.6 at 256K. Numbers were measured on a 7.3-rc7 kernel with the IOMMU PerfOpt series, and the user expects lower prefill on stock kernels.