llamaperf

Qwen3.6 35B (3B active)

on M5 32GB · oMLX

Tone: positiveApple hardware
Oct 27, 2026
Throughput
40.0 t/s gen
KV cache
8-bit
System RAM
32 GB

Use cases

codingagentic

Summary

User reports Qwen 3.6 35B-A3B at about 40 tok/s on an M5 MacBook Pro with 32GB unified memory, against about 17 tok/s for a dense 27B at 4-bit. Setup uses oMLX with an SSD-backed cache server, 8-bit KV cache and context set to roughly 32K. The user says the 16GB dense model plus KV cache filled the 32GB machine and caused a shutdown; the MoE has been stable since.