Qwen3.8 27B
on M5 Max · MTPLX · 262,144 ctx
Use cases
coding
Summary
User reports Qwen3.8 27B Optimized Speed at 58.7 tok/s on a MacBook Pro M5 Max.
Setup is MTPLX with a 4-bit dynamic MLX quant and native multi-token-prediction speculative decoding at depth 3, single stream, 262,144-token context window, 20.4 GB download and 23.6 GB peak unified memory.
The same coding task ran 55.5 tok/s inside the MTPLX Mac app, and long reasoning at xhigh gave 35.1 and 37.3 tok/s on 28k and 20k token answers. For comparison on the same task, Qwen 3.6 27B Optimized Speed V2 ran 59.9 to 60.1 tok/s and oMLX 0.5.7 with its own Qwen 3.8 4-bit MTP quant ran 63.3 tok/s.