Gemma 4 DiffusionGemma-26B-A4B-it
on AMD Ryzen AI Max+ 395 / Radeon 8060S (Strix Halo; 121 GiB unified memory reported) · Gufo · 131,072 ctx
Summary
User reports Gemma 4 at 3180 t/s prompt processing on one AMD Ryzen AI Max+ 395 / Radeon 8060S integrated GPU (Strix Halo).
Setup is the Gufo native HIP engine with Q8_0 GGUF and a 131072-token context, one request at a time.
The 3180 t/s is native prefill for a 2,261-input-token book prompt producing 512 output tokens, with TTFT 6.0 s and 141 ms per denoising step; prefill falls to 1,339 t/s at 121,294 input tokens.