Gemma 4 26B (4B active)
on AMD Strix Halo 128GB · llama.cpp
Summary
User reports Gemma 4 26B-A4B at 41.6 t/s generation and 1698.9 t/s prefill on an AMD Strix Halo 128GB machine.
Setup is llama.cpp with Q8_K_XL, ROCm 7.2.3 HIP backend, Flash Attention enabled, -ngl 99, -b 2048 and -ub 2048, on one Ryzen AI MAX+ 395 with 128 GB unified memory.
The headline combines two separate phase tests, pp512 and tg128, not one paired request; the same model's baseline control reports pp512 = 1369.67 and tg128 = 41.61 t/s.