LLaMA family 7B / Q8_0 / Mac mini M4 Metal b1550 / PP512 TG128 / exact base and artifact unknown
on M4 32GB · llama.cpp b1550 (8e672efe) / Metal
Summary
User reports LLaMA-family 7B mostly Q8_0 at 13.5 t/s generation and 223.6 t/s prompt processing on a Mac mini M4 with 32 GB unified RAM.
Setup is llama.cpp build 1550 with Q8_0 and F16 KV cache, Metal backend at ngl 99, one GPU.
The figures are llama-bench PP512 and TG128, independent synthetic prompt and generation tests rather than a 512-token prompt followed by a 128-token answer.