llamaperf

Gemma 4 5.1B E2B

on Unknown GPU · LiteRT

Tone: positive
Oct 25, 2026
Throughput
5.5 t/s gen

Summary

User reports Gemma 4 E2B running at a consistent 5.5 t/s on an Android phone, with peaks up to 8.8 t/s, in Italian. Setup is LiteRT on the phone's mobile processor, after switching from llama.cpp and updating the device from Android 15 to 16. The user also reports Qwen2.5 1.5B at a consistent 8 t/s on the same device, and says the setup shows local AI on Android is doable without expensive hardware.