Qwen3.6 35B (3B active)
on M2 Max 32GB · llama.cpp · 4,096 ctx
Summary
User benchmarks Qwen3.6-35B-A3B at 58.56 t/s generation and 671.40 t/s prefill on an M2 Max 32GB.
Setup is llama.cpp build c1d0e7a00 with Metal backend, Q4_K_M GGUF (20.22 GiB), 4096-token prompt, no speculative decoding.
The dataset reports mostly negative results: MoE beats dense Qwen3.8-27B by 5.4x generation, aggressive quantization bought little, MTP and DFlash2 speculative decoding were net losses on Metal, and q8_0 KV cache was free. MLX reached 86.9 t/s generation but only 296 t/s prefill versus llama.cpp's 57.8 t/s and 685 t/s. oMLX with paged SSD KV cache reached 13.7 t/s generation and 84 t/s prefill on the dense 27B.