llamaperf

Gemma 4 26B (4B active)

on NVIDIA RTX 5070 Ti · llama.cpp

NVIDIA hardware
Oct 18, 2026
Throughput
137.7 t/s gen · 5951.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-IQ4_XS (GGUF)
KV cache
K q8_0, V q4_0

Summary

User reports 137.7 t/s generation and 5951 t/s prompt processing. Source evidence (verbatim): Source: https://algollabs.com/blog/gemma4-bfcl # Gemma 4 26B on consumer-grade GPU: Benchmarks, Build Pain, and a Week of Daily Use Hardware: NVIDIA RTX 5070 Ti 16 GB GDDR7, AMD Ryzen 9 9950X3D, 64 GB DDR5, Fedora 43, kernel 6.18. Engine: llama.cpp build 9024 built from source with GGML_CUDA_FA_ALL_QUANTS=ON. Model: Gemma 4 26B A4B Instruct (26B total, 3.8B active), unsloth/gemma-4-26B-A4B-it-GGUF UD-IQ4_XS, 12.65 GiB, full GPU offload (31 of 31 layers), flash attention on, asymmetric KV cache (K q8_0, V q4_0). llama-bench, no speculative decoding or MTP, single stream: 5,951 tokens/s prompt processing (pp2048) and 137.7 tokens/s token generation (tg64).