Gemma 4 26B (4B active)

User reports Gemma 4 26B-A4B at 6.86 t/s generation and 2181.18 t/s prompt processing on an RTX 5070 Ti with ik_llama.cpp. Setup is ik_llama.cpp with Q4_K_XL GGUF and q8_0 KV cache, 30 MoE layers offloaded to CPU, 8192-token prompt and 128-token generation. Upstream llama.cpp on the same hardware and model reaches 30.10 t/s generation and 577.00 t/s prompt processing, making ik_llama.cpp about 4.4x slower for generation despite being 3.8x faster for prompt processing. Disabling CUDA graphs, using q4_0 KV cache, or keeping the last 4 MoE layers on GPU did not resolve the generation slowdown.