Gemma 4 12B
on M4 Pro 64GB · dasLLAMA
Summary
User reports Gemma 4 12B at 30.9 t/s generation and 298.5 t/s prompt processing on an M4 Pro with 64 GB unified memory.
Setup is dasLLAMA version 16 with Q4_K_M weights and f16 KV cache, one GPU, 640 positions allocated.
The figures are native PP512 and TG128 means over five repetitions, not a single 512-input/128-output request; a separate four-stream run reached 34.18746480210349 t/s summed scheduler throughput.