Qwen3.6 27B
on M2 Ultra 137GB
Summary
User reports Qwen3.6-27B at 52.1 tok/s on an M2 Ultra 137GB with n-gram self-speculative decoding using one draft token.
The run used an experimental 2-bit mixed quant recipe (quant2-all); the model is hybrid with 48 GDN and 16 SA layers. The 1-draft configuration gave a 44% draft hit rate and a 17% speedup.
User notes higher draft counts are counterproductive due to quadratic multi-token forward overhead on bandwidth-bound models, and that the gain is architecture-level rather than tied to weight precision.