llamaperf

Llama 3.2 3B

on M4 16GB · Ollama

Apple hardware
Oct 10, 2026
Throughput
45.4 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
16 GB

Summary

User reports Llama 3.2 3B at 45.4 t/s generation on a Mac mini M4 16GB. Setup is Ollama 0.30.8 at Q4_K_M on Metal, one request, speculative decoding off. Mean of two runs by ai-local-lab, measured 2026-06-16. A source-reported measurement, not independently reproduced.