llamaperf

Gemma 4 12B

on NVIDIA RTX A2000 12GB · Ollama

Tone: positiveNVIDIA hardware
Oct 18, 2026
Throughput
28.2 t/s gen
System RAM
32 GB
VRAM reported
12 GB

Use cases

coding

Summary

User reports Gemma 4 12B at 28.22 t/s on the RAID 1 explanation task, run on an RTX A2000 12GB in a Lenovo ThinkCentre M920x Tiny with an i5-9500T and 32 GB RAM. Setup is Ollama on Ubuntu 26.04.1 with Open WebUI in Docker; the model sat fully on the GPU and drew up to 82 W during the run. The Python task was not verified for this model. The same machine ran seven other models: DeepSeek Coder V2 16B was fastest at 45.86 and 46.03 t/s, Qwen3 8B at 30.80 and 31.25 t/s, Qwen3.5 9B at 23.23 and 22.94 t/s, Gemma 3 12B at 20.58 and 20.33 t/s, Ministral 3 14B at 19.82 and 20.29 t/s, Qwen3 14B at 16.60 and 18.53 t/s, and a Qwen of about 27B fell to 1.45 and 1.99 t/s with CPU offload. Idle draw was about 15 W.