Gemma 4 5.1B E2B

User benchmarks Gemma 4 E2B QAT GGUF on a Pixel 8 Pro (Tensor G3) with llama.cpp, reporting 58 prompt tok/s and 5.0 gen tok/s with 4 threads pinned to medium cores 4-7. Setup is llama.cpp via the Rust llama-cpp-2 crate, QAT GGUF (2.6 GB), 4096 context, q8_0 KV cache, CPU-only. The fastest setup was 5 threads pinned to cores 4-8 at 70 prompt tok/s and 4.9 gen tok/s, while 4 medium cores were within 8% and used about 10% less battery. Vulkan on Mali was 3x slower with all layers on GPU and 8x slower with half the layers. The user notes that Android background apps only get the small cores, around 14 s per item.