LLaMA family 7B / Q4_0 / Mac mini M4 Metal b1550 / PP512 TG128 / exact base and artifact unknown
on M4 32GB · llama.cpp b1550 (8e672efe) / Metal
Summary
User reports LLaMA-family 7B at 24.1 t/s generation and 221.3 t/s prompt processing on a Mac mini M4 with 32 GB unified RAM.
Setup is llama.cpp build 1550 with Q4_0 and F16 KV cache, Metal backend at ngl 99 on one GPU.
The figures are llama-bench PP512 and TG128 synthetic tests, not a 512-token prompt followed by a 128-token answer; exact source rates are 221.29 and 24.11 t/s.