Qwen3.8 125B (6B active) Flash-Next
on AMD Strix Halo 128GB · Halogen · 262,144 ctx
Use cases
agenticcodingtool-uselong-context
Summary
User reports Qwen3.8 Flash-Next 125B FP4 decoding at 62-68 tok/s on a Strix Halo 128GB mini PC (Ryzen AI Max+ PRO 495) under real agent traffic.
Setup is the Halogen engine with a ~54GB FP4 checkpoint plus a ~48GB n-gram table and MTP drafter, 262k context and 4 concurrent slots; cold 28k prefill ran at ~1.9-2.1k tok/s and prompt cache hit rate was 98-99.6%.
MiniMax-M3.1-Flash (428B, 93GB IQ1_S/IQ2_XXS quant) loaded but decoded at about 1 tok/s because 31% of experts streamed from NVMe; GLM-5.3-Flash ran at ~21 tok/s and Qwen3-30B-A3B at 70-93 tok/s. The model scored 73.3/100 on the user's Godot agent benchmark.