APPLE · 32GB unified memory · 2 reports
Use the calculator to check which models fit in 32 GB of unified memory. The reports below include different GPU counts and memory setups; a model listed here may need extra cards or CPU offloading.
How to compare these reports →All M5 Macs compared →Reported by the source; GPU count, offloading and concurrent requests can change this figure. Check the full setup before comparing.
User reports DeepSeek V4 Flash 0731 at about 50 t/s prefill and about 1 t/s decode on an M5 Air with 32 GB. Setup uses the streamed experts trick with a model of roughly 300B total parameters.
Reported by the source; GPU count, offloading and concurrent requests can change this figure. Check the full setup before comparing.
User reports custom w8a8 kernels on an M5 MacBook Air, with prefill improving from 2193 t/s to 3029 t/s for 130k tokens. User also mentions llama.cpp for Macs.