Gemma 4 8B E4B
on NVIDIA RTX 4070 Ti · llama.cpp
Summary
User reports Gemma 4 E4B at 69.66 t/s generation and 6757.3 t/s prompt processing on an NVIDIA RTX 4070 Ti.
Setup is llama.cpp with Q8_0 and requested GPU layers 999, a direct full-offload run on a 12GB card.
The figures come from a synthetic pp512/tg128 test at zero context depth, so they do not measure generation after a filled context.