llamaperf

Gemma 4

on Tensor G5 · LiteRT-LM · 32,768 ctx

Oct 3, 2026
Throughput
11.0 t/s gen
System RAM
16 GB

Summary

User reports Gemma 4 E4B at about 11 tok/s steady-state decode on a Pixel 10 Pro XL (Tensor G5, 16 GB shared memory). Setup is an Android OpenAI-compatible server app (PixelUnlockGPU) running the model on-device via LiteRT-LM with a GPU bundle of 2.97 GB and context capped at 32k; follow-up turns take about 1.7 s because the KV prefix is reused across turns, and the engine warm build takes about 12 s once per model change. The user notes the NPU path aborts on stock Tensor G5 firmware so GPU is the shipping backend, short replies read slower than 11 tok/s because warm and prefill dominate, and token counts are estimated at about 4 chars/token since LiteRT-LM exposes none.