llamaperf

Gemma 4 8B E4B

on Unknown GPU · L-AI

Oct 16, 2026
Throughput
6-7 t/s gen
Quant
Q8
System RAM
16 GB

Summary

User reports running Gemma 4 E4B IT Q8 on a OnePlus Pad 3 with 16GB RAM using L-AI, getting 6-7 tok/s. Qwen2.5-1.5B reached 9-10 tok/s and Qwen3-0.6B-F16 reached 37 tok/s on the same device. The runs are CPU-only on the tablet. User asks whether anyone is working on a proper interface for running these models that supports uploading files and photos.