llamaperf

Qwen3.6 35B (3B active)

on M4 Pro 48GB · Rapid-MLX

Apple hardware
Oct 8, 2026
Throughput
104.5 t/s gen
Quant
MLX 4-bit (MLX)
System RAM
48 GB

Summary

User reports Qwen3.6-35B-A3B at 104.5 tokens/s single-stream decode on an Apple Mac mini M4 Pro with 48 GB unified memory. Setup is Rapid-MLX 0.15.4 with MLX 4-bit weights (17.5 GB on disk). The figure is the median of three runs at temperature 0. Separately, the source reports 106.5 tokens/s aggregate with four concurrent streams and a 2.4 s TTFT for a 2K-token prompt. The 23.2 GB Metal peak covers the whole sweep, not single-stream use. These are developer-produced measurements; the linked raw-data directory returned a 404 when checked.