llamaperf

Gemma 4 DiffusionGemma-26B-A4B-it

on AMD Ryzen AI Max+ 395 / Radeon 8060S (Strix Halo; 121 GiB unified memory reported) · Gufo · 131,072 ctx

Oct 13, 2026
Throughput
2901.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
BF16 (safetensors)

Summary

User reports Gemma 4 at 2901 t/s prompt processing on one AMD Ryzen AI Max+ 395 / Radeon 8060S integrated GPU (Strix Halo). Setup is the Gufo native HIP engine with BF16 safetensors and a configured context of 131072 tokens, one request at a time. The figure is native prefill for a 2,261-input-token book prompt with 512 output tokens, at TTFT 7.0 s and 184 ms per denoising step; prefill falls to 1,344 t/s at 121,294 input tokens.