llamaperf

Qwen3.6 35B (3B active)

on M5 Max 36GB · mlx-serve

Apple hardware
Nov 20, 2026
Throughput
178.0 t/s gen
Quant
4-bit (MLX)
System RAM
36 GB

Summary

User benchmarks eight MLX inference servers across 11 models on an M5 Max 36GB, M4 Pro 48GB and M2 Pro 32GB. On the M5 Max, Qwen3.6 35B-A3B reaches 178 t/s in mlx-serve, the fastest of the engines tested. Runs use each engine's default flags, one request at a time, a ~540-token prompt and 256 output tokens, median of 3 reps, with 4-bit MLX builds except the ternary Bonsai models and 8-bit LFM3. mlx-serve has the best average at 98.2% of the row best but failed to load 6 cells; Rapid-MLX loads everything and averages 98.0%, with MTP on by default where a checkpoint has an MTP head. Qwen3.6 35B-A3B spans 107 to 178 t/s on the M5 Max depending on engine, and Rapid-MLX with MTP off gives 171.6 t/s there and 98.9 t/s on the M4 Pro.