Gemma 4 8B E4B

Oct 10, 2026

Throughput

69.7 t/s gen · 1172.9 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

Q4_K_M (GGUF)

System RAM

128 GB

Summary

User reports Gemma 4 E4B at 69.7 t/s generation and 1172.9 t/s prefill on an M1 Ultra 128GB. Setup is llama.cpp at Q4_K_M, one request, speculative decoding off. Fazal Majid's llama-bench run published 2026-04-13. A source-reported measurement, not independently reproduced.