Qwen3.8 Flash-Next REAP-288
on M4 Max · mlx-vlm
Use cases
codingagentic
Summary
User reports Qwen3.8-Flash-Next REAP-288 at ~28 tok/s decode on an M4 Max.
Setup is stock mlx-vlm with MLX 4-bit weights and the full n-gram table resident at about 68 GB; the build keeps 288 of 512 experts per MoE layer.
Decode is runtime-dependent: 28-65 tok/s overall, with ~37 tok/s on pmlx streamed from NVMe and ~65 tok/s peak, ~41 tok/s sustained at 4K on pmlx with the table in RAM. HumanEval pass@1 is 91.5% versus 93.9% for the stock 512-expert Q4 build.