Qwen3.8 125B (6B active) Flash-Next
on M4 Max 128GB · oMLX · 128,000 ctx
Oct 4, 2026
Summary
User reports Qwen3.8-Flash-Next at 50~70 tg/s at 128k context on an M4 Max 128GB.
Setup is oMLX 0.7.0 with an oQ4e MLX quant and MTP speculative decoding enabled; memory use is 75~80 GB at that context length.
User says older versions dropped from 60 tg/s to 35 tg/s once context passed 30k, and that the speed now holds as context grows.