Gemma 4 5.1B E2B
on Unknown GPU · LiteRT
Summary
User reports Gemma 4 E2B running at a consistent 5.5 t/s on an Android phone, with peaks up to 8.8 t/s, in Italian.
Setup is LiteRT on the phone's mobile processor, after switching from llama.cpp and updating the device from Android 15 to 16.
The user also reports Qwen2.5 1.5B at a consistent 8 t/s on the same device, and says the setup shows local AI on Android is doable without expensive hardware.