Qwen3.6 35B (3B active)
on M5 Max 36GB · mlx-serve
Summary
User benchmarks eight MLX inference servers across 11 models on an M5 Max 36GB, M4 Pro 48GB and M2 Pro 32GB. On the M5 Max, Qwen3.6 35B-A3B reaches 178 t/s in mlx-serve, the fastest of the engines tested.
Runs use each engine's default flags, one request at a time, a ~540-token prompt and 256 output tokens, median of 3 reps, with 4-bit MLX builds except the ternary Bonsai models and 8-bit LFM3.
mlx-serve has the best average at 98.2% of the row best but failed to load 6 cells; Rapid-MLX loads everything and averages 98.0%, with MTP on by default where a checkpoint has an MTP head. Qwen3.6 35B-A3B spans 107 to 178 t/s on the M5 Max depending on engine, and Rapid-MLX with MTP off gives 171.6 t/s there and 98.9 t/s on the M4 Pro.