llamaperf

Qwen3.8 Flash-Next REAP-288

on M4 Max · mlx-vlm

Oct 7, 2026
Throughput
28.0 t/s gen
Quant
4bit (MLX)

Use cases

codingagentic

Summary

User reports Qwen3.8-Flash-Next REAP-288 at ~28 tok/s decode on an M4 Max. Setup is stock mlx-vlm with MLX 4-bit weights and the full n-gram table resident at about 68 GB; the build keeps 288 of 512 experts per MoE layer. Decode is runtime-dependent: 28-65 tok/s overall, with ~37 tok/s on pmlx streamed from NVMe and ~65 tok/s peak, ~41 tok/s sustained at 4K on pmlx with the table in RAM. HumanEval pass@1 is 91.5% versus 93.9% for the stock 512-expert Q4 build.