Gemma 4 12B
on NVIDIA RTX A2000 12GB · Ollama
Use cases
coding
Summary
User reports Gemma 4 12B at 28.22 t/s on the RAID 1 explanation task, run on an RTX A2000 12GB in a Lenovo ThinkCentre M920x Tiny with an i5-9500T and 32 GB RAM.
Setup is Ollama on Ubuntu 26.04.1 with Open WebUI in Docker; the model sat fully on the GPU and drew up to 82 W during the run.
The Python task was not verified for this model. The same machine ran seven other models: DeepSeek Coder V2 16B was fastest at 45.86 and 46.03 t/s, Qwen3 8B at 30.80 and 31.25 t/s, Qwen3.5 9B at 23.23 and 22.94 t/s, Gemma 3 12B at 20.58 and 20.33 t/s, Ministral 3 14B at 19.82 and 20.29 t/s, Qwen3 14B at 16.60 and 18.53 t/s, and a Qwen of about 27B fell to 1.45 and 1.99 t/s with CPU offload. Idle draw was about 15 W.