llamaperf

M2 8GB

APPLE · 8GB unified memory · 1 report

See what fits on this GPU →

Use the calculator to check which models fit in 8 GB of unified memory. The reports below include different GPU counts and memory setups; a model listed here may need extra cards or CPU offloading.

How to compare these reports →All M2 Macs compared →
This page is thin (1 of 3 reports needed for indexing). Help fill it in.
Tone: positive
reported speed:
5.5 tokens/s generation

Reported by the source; GPU count, offloading and concurrent requests can change this figure. Check the full setup before comparing.

User reports 31-35 t/s on an M5 MacBook Pro with a custom Swift/Metal engine. Setup is an OpenAI-compatible server with streaming and tool-call support.

Jul 30, 2026