Gemma 4 31B

User benchmarks 18 tool-calling models on 33 recorded DevOps failure scenarios on a single RTX 5090 32GB, reporting gemma4:31b at 64 tokens/s with a 94% pass rate and 23.1 GiB measured VRAM. Setup is Ollama 0.35.0 with each model's default build (Q4_K_M, except gpt-oss:20b at MXFP4), 32k context, temperature 0, one run each; VRAM is what nvidia-smi showed for the Ollama process. The top six models tie between 88% and 94%, separated by speed and memory; the fastest model on the card (nemotron-3.5-lightning:30b at 427 tokens/s) passes 52%, and gemma4:12b passes 88% in 9.2 GiB. Ollama's own ollama ps size under-reported real GPU usage by 0.6 to 4.2 GiB for 17 of 18 models. north-mini-code-1.0 could not run due to a CUDA illegal memory access error. Nothing spilled to CPU.