llamaperf

Qwen3.6 35B (3B active)

on M3 Ultra · MLX · 1,024 ctx

Oct 6, 2026
Throughput
89.5 t/s gen · 2665.3 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
5.4bit (MLX)

Summary

User benchmarks Qwen3.6-35B-A3B at 89.49 t/s generation and 2665.31 t/s prompt processing on a Mac Studio M3 Ultra. Setup is MLX with a 5.4-bit mixed-precision quant (4-bit baseline with important layers at 8-bit and BF16), 1024 prompt tokens and 512 generation tokens, peak memory 24.741 GB. The model is compared against 4-bit, 4.4-bit-msq, and 4.8-bit versions; the 5.4-bit quant achieves the lowest KL divergence (0.0189) but lower generation speed than the 4-bit baseline (108.50 t/s).