LLaMA family 7B / Q8_0 / Mac mini M2 Metal b1550 / PP512 TG128 / exact base and artifact unknown
on M2 24GB · llama.cpp b1550 (8e672efe) / Metal
Summary
User reports a LLaMA-family 7B model mostly Q8_0 at 12.2 t/s generation and 181.4 t/s prompt processing on a Mac mini M2 with 24 GB unified RAM.
Setup is llama.cpp build 1550 with Q8_0 and F16 KV cache, Metal backend at ngl 99, one GPU.
The figures are native llama-bench PP512 and TG128 synthetic tests, not a 512-token prompt followed by a 128-token answer; the source rates are 181.40 ± 0.05 t/s and 12.21 ± 0.04 t/s.