Qwen3.6 27B
on M4 Pro 48GB · MLX · 4,096 ctx
Summary
User reports Qwen 3.6 27B at 18.3 tok/s decode on an Apple M4 Pro with 48 GB unified memory.
Setup is MLX with 4-bit weights, 4096 context, and native MTP speculative decoding at depth 3.
Without MTP the model decodes at about 7 tok/s; served over WiFi it reaches 14.3 tok/s, and llama.cpp with MTP gives 10.5 tok/s.