Oct 12, 2026
Summary
User reports Qwen3 30B-A3B at 144.4 t/s on an M5 Max with 128GB unified memory.
Setup is MLX with 4-bit affine quantization, group size 64, standard 8 routed experts per token, batch 1 with a 944-token prompt and 512 output tokens.
The figure is the arithmetic mean of six fresh-process runs, ranging 144.10 to 145.01 t/s; an altered 6-expert routing gave 155.61 t/s but is not a standard-model result.