llamaperf

Qwen3.5 35B (3B active)

on M4 Pro 64GB · mlx_lm · 512 ctx

Apple hardware
Oct 9, 2026
Throughput
49.3 t/s gen
Quant
8-bit (MLX)
System RAM
64 GB

Summary

User reports Qwen3.5-35B-A3B at 49.3 t/s on an M4 Pro Mac mini with 64GB unified memory. Setup is mlx_lm with 8-bit weights, single request, 512-token context and 512 output tokens. Figure is transcribed from SiliconBench (arXiv:2609.19169v1, Table 4), a single-node baseline, not a multi-node result; the 512-token context is the tested workload, not a maximum. Quantization scheme, runtime version, GPU core count, KV-cache precision and sampling settings are not established for this row.