llamaperf

Gemma 4 26B (4B active)

on NVIDIA RTX 4090

Tone: positiveNVIDIA hardware
Jun 4, 2026
Throughput
138.0 t/s gen
VRAM reported
24 GB

Use cases

coding

Summary

User benchmarks Gemma 4 26B-A4B against Gemma 4 12B on an RTX 4090. The 26B-A4B runs at 138 tok/s using 15 GB of VRAM, while the 12B runs at 80 tok/s using 9 GB. The 26B-A4B wins every scene and runs about 1.7x faster. The user notes the 12B is ideal for a 16 GB laptop.