Gemma 4 26B (4B active)
on NVIDIA RTX 5070 Ti · llama.cpp
Summary
User reports 137.7 t/s generation and 5951 t/s prompt processing.
Source evidence (verbatim):
Source: https://algollabs.com/blog/gemma4-bfcl
# Gemma 4 26B on consumer-grade GPU: Benchmarks, Build Pain, and a Week of Daily Use
Hardware: NVIDIA RTX 5070 Ti 16 GB GDDR7, AMD Ryzen 9 9950X3D, 64 GB DDR5, Fedora 43, kernel 6.18. Engine: llama.cpp build 9024 built from source with GGML_CUDA_FA_ALL_QUANTS=ON. Model: Gemma 4 26B A4B Instruct (26B total, 3.8B active), unsloth/gemma-4-26B-A4B-it-GGUF UD-IQ4_XS, 12.65 GiB, full GPU offload (31 of 31 layers), flash attention on, asymmetric KV cache (K q8_0, V q4_0). llama-bench, no speculative decoding or MTP, single stream: 5,951 tokens/s prompt processing (pp2048) and 137.7 tokens/s token generation (tg64).