Qwen3.6 27B
on M2 Max 96GB · llama.cpp · 256,000 ctx
Use cases
codingagentic
Summary
User benchmarks Qwen 3.6 27B F16 on an M2 Max 96GB with llama.cpp and MTP speculative decoding, reporting 8-18 tok/s depending on the task.
Without MTP the same setup reaches 6.6 tok/s. A Q8 quant was also tested but performed worse.
Context up to 150k+ tokens is usable. The user notes chat template fixes were critical, and the setup was used for agentic coding to create a Pacman game.