llamaperf
Oct 12, 2026
Throughput
98.2 t/s gen
Quant
MLX 4-bit affine, group 64 (MLX)
System RAM
64 GB

Summary

User reports Qwen3 30B-A3B at 98.2 t/s on an M5 Pro with 64GB unified memory. Setup is MLX with 4-bit affine quantization, group size 64, standard 8 routed experts per token, batch 1, 944-token prompt and 512 output tokens. The figure is the arithmetic mean of six fresh-process runs, ranging 97.97 to 98.37 t/s; an altered 6-expert run reached 107.79 t/s but is not a standard-model result.