Qwen3.6 35B (3B active)
on M3 Ultra · MLX · 1,024 ctx
Summary
User benchmarks Qwen3.6-35B-A3B at 89.49 t/s generation and 2665.31 t/s prompt processing on a Mac Studio M3 Ultra.
Setup is MLX with a 5.4-bit mixed-precision quant (4-bit baseline with important layers at 8-bit and BF16), 1024 prompt tokens and 512 generation tokens, peak memory 24.741 GB.
The model is compared against 4-bit, 4.4-bit-msq, and 4.8-bit versions; the 5.4-bit quant achieves the lowest KL divergence (0.0189) but lower generation speed than the 4-bit baseline (108.50 t/s).