Gemma 4 31B
on AMD Ryzen AI Max+ 395 / Radeon 8060S (Minisforum MS-S1; one participating GPU; total installed RAM unreported) · llama.cpp
Summary
User reports Gemma 4 31B at 6.2 t/s generation and 293.1 t/s prompt processing on a Minisforum MS-S1 with an AMD Ryzen AI Max+ 395 (Strix Halo) and Radeon 8060S Graphics.
Setup is llama.cpp with UD-Q8_K_XL, flash attention on, one CPU thread, batch and ubatch 2048, and ngl 99 on Vulkan.
The pp2048 and tg128 figures are separate synthetic tests, not one 2048-in/128-out request, and TG was not measured after the largest PP context.