Qwen3.8 125B (6B active) Flash-Next
on M3 Max 64GB · oMLX · 130,000 ctx
Summary
User reports Qwen3.8-Flash-Next at 15.8 tok/s generation and 140.0 tok/s prompt processing on an M3 Max 64GB.
Setup is oMLX with an oQ4e quant, Lightning MTP on, MoE expert offload on and 50% resident experts, running a 99GB model at up to 130k context.
Figures come from a 13-request session with PI: 321,309 total prefill tokens, 292,209 cached (90.9% cache efficiency), so the prompt rate excludes cached tokens.