llamaperf

Qwen3.6 35B (3B active)

on M5 16GB · mlx_lm

Apple hardware
Oct 28, 2026
Throughput
15.0 t/s gen
Quant
4-bit (MLX)
System RAM
16 GB

Summary

User reports Qwen3.6-35B-A3B at 15.0 tokens/s on an M5 MacBook Air with 16 GB RAM, keeping routed experts on SSD and loading only those selected by the MoE router. Setup uses MLX with a 4-bit checkpoint, around 1.7 GB of MLX memory, top-8 routing unchanged and no experts dropped; output is byte-identical to stock mlx_lm. The 15.0 t/s is a controlled benchmark, 72.6% faster than direct SSD streaming; with other apps open it is around 11.8 t/s, and time to first token for a short prompt is around 2.3 seconds.