Qwen3.6 35B (3B active)
on M1 Pro 32GB · llama.cpp · 32,768 ctx
Use cases
codingagentictool-uselong-context
Summary
User reports Qwen3.6-35B-A3B at 25.4 tok/s decode and 38.6 tok/s prefill on a MacBook Pro M1 Pro 32GB.
Setup is llama.cpp build b9466 with Q4_K_S GGUF and q8_0/q4_0 KV cache at 32K context, single sequence, all layers on the Metal GPU.
User compares the MoE against dense Qwen3.6-27B on the same host: the dense model decodes at 5.3 tok/s and prefills at 12.9 tok/s, uses 17.9 GB wired versus 22.4 GB, and swaps ~1 GB versus ~7.6 GB. Prefill is the bottleneck; cold TTFT on a 7.5K prompt is 92.8 s versus 0.2 s warm. Tool-calling was clean in 10/10 episodes.