Gemma 4 26B (4B active)
on NVIDIA RTX 5090 · 50,000 ctx
Summary
User reports nvidia/Gemma-4-26B-A4B-NVFP4 running on an RTX 5090 with 80% of the 32 GB allocated, reaching around 50k context.
The model is 18.8 GB.
Benchmarks compare baseline against NVFP4: GPQA Diamond 80.30% vs 79.90%, AIME 2025 88.95% vs 90.00%, MMLU Pro 85.00% vs 84.80%, LiveCodeBench pass@1 80.50% vs 79.80%, IFBench 77.77% vs 78.1%, and IFEval 96.60% vs 96.40%.