Qwen3.5 4B
on M6 32GB · MLX
Summary
User reports Qwen3.5-4B at 16.24 t/s generation and 438.97 t/s prefill on an Apple M6 Mac mini with 32GB unified memory.
Setup is MLX 0.32.2 with MLX-LM 0.31.3, a controlled affine 4-bit (Q4) MLX package with group size 64 and 16-bit KV cache, single request, 2048 input tokens and 128 generated tokens.
Measurements are from Precisit's published benchmark, not an independent rerun; decode excludes first-token production and model loading, and the 2048-token input is not a configured context limit.