llamaperf

Gemma 4 26B (4B active)

on NVIDIA RTX 5060 Ti 16GB

Tone: positiveNVIDIA hardware
Sep 26, 2026
Throughput
80-90 t/s gen
Quant
IQ4_XS (GGUF)
VRAM reported
16 GB

Summary

User reports Gemma 4-26b-a4b at 80~90 t/s at 2048 context and 40+ t/s at 96K context on an RTX 5060 Ti 16GB. Setup is IQ4-XS quantization on an Intel i7-4790 with DDR3 1600MHz RAM. User compares it favorably to Qwen 3.5-35b-a3b at 45 t/s and notes the older DDR3 platform limits memory bandwidth.