LLaMA family 7B / Q4_0 / Mac mini M2 Metal b1550 / PP512 TG128 / exact base and artifact unknown
on M2 24GB · llama.cpp b1550 (8e672efe) / Metal
Summary
User reports a LLaMA-family 7B model at 21.9 t/s generation and 179.6 t/s prompt processing on a Mac mini M2 with 24 GB unified RAM.
Setup is llama.cpp build 1550 with Q4_0 quantization, F16 KV cache, Metal backend and ngl 99, running llama-bench PP512 and TG128.
The figures are independent synthetic prompt and generation tests, not a 512-token prompt followed by a 128-token answer; the source rates are 179.57 ± 0.04 t/s and 21.91 ± 0.02 t/s.