LLaMA family 7B / F16 / Mac mini M4 Metal b1550 / PP512 TG128 / exact base and artifact unknown
on M4 32GB · llama.cpp b1550 (8e672efe) / Metal
Summary
User reports a LLaMA-family 7B model at 7.4 t/s generation and 230.2 t/s prompt processing on a Mac mini M4 with 32 GB unified RAM.
Setup is llama.cpp build 1550 with F16 quantization and F16 KV cache, Metal backend at ngl 99, one GPU.
The figures are llama-bench PP512 and TG128 results, independent synthetic prompt and generation tests rather than a 512-token prompt followed by a 128-token answer; exact source rates are 230.18 ± 0.16 t/s and 7.43 ± 0.02 t/s.