llamaperf

Qwen3.6 35B (3B active)

on M2 Pro 32GB · MLX

Apple hardware
Oct 12, 2026
Throughput
61.7 t/s gen · 276.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
4-bit group-64 (MLX)
System RAM
32 GB

Summary

User reports Qwen3.6 35B-A3B at 61.7 t/s generation and 276.8 t/s prompt processing on a Mac mini with Apple M2 Pro and 32 GB unified memory. Setup is mlx-lm 0.31.3 with MLX 0.31.2, MLX 4-bit group-64 weights of about 19.0 GiB, temperature 0 and --max-tokens 128. The figures are medians of three runs on a 490-token prompt with 128 tokens generated; peak memory was 20.261 GB per run.