Qwen3.8 125B (6B active) Flash-Next
on M1 Max 32GB · MoEspresso
Use cases
codingmath
Summary
User reports Qwen3.8-Flash-Next (125B) at 12-15 decode tokens per second on a 2021 M1 Max with 32 GB of unified memory.
Setup is MoEspresso 3 with IQ2_K routed projections and KVarN K4/V4 KV cache, using Metal execution through the mlx-iqk library. Cache-Prior expert bias is enabled by default; prefill is unbiased. The user notes the speed holds only when no other memory-hungry applications are running.
The user also reports an overall score of 84.3% on a reproducible 48-question benchmark, ahead of Claude Opus 4.8 xhigh (80.3%) and other hosted solutions.