llamaperf

Qwen3.6 27B

on M4 Pro · MLX

Oct 8, 2026
Throughput
24.6 t/s gen
Quant
4-bit (MLX)

Summary

User reports Qwen3.6-27B 4-bit at 24.6 t/s with native MTP speculative decoding on an M4 Pro, up from 15.7 t/s baseline (1.57x). Setup is MLX with the MTP head enabled at temp=0, 3 runs x 8 prompts, acceptance 88.3% (A/V). At temp=0.6 MTP gives 24.0 t/s (1.53x) and at temp=1.0 23.5 t/s (1.50x). Qwen3.5-27B 4-bit goes 15.3 to 24.0 t/s (1.57x) and Qwen3.5-35B-A3B 4-bit only 85.3 to 87.9 t/s (1.04x), the MoE gain being marginal. Other users' results cited: M2 Ultra 8-bit 35B-A3B 1.11x and 122B-A10B 1.09x, M5 Max 4-bit 9B +11.3%, 27B +35.5%, 122B +12.4%, M5 Pro 4-bit 27B +31.4%.