Gemma 4 12B

User benchmarks Gemma 4 12B at 82.7 tok/s decode on vLLM and 85.0 tok/s on Ollama on one RTX 3090 24 GB capped at 300 W. Setup is vLLM 0.30.0 with Google's W4A16 QAT checkpoint and Ollama 0.34.4 with gemma4:12b-it-qat, temperature 0, 256 tokens out, one request at a time. At sixteen concurrent requests vLLM reached 506.8 tok/s against Ollama's 142.3 tok/s; first token was 213.0 ms on vLLM against 441.9 ms on Ollama. Board energy at sixteen requests was 590 joules per 1,000 tokens on vLLM and 1,384 on Ollama. On 108 questions the two agreed on 63 strictly and 98 leniently.