Llama 3.2 1B / Vulkan b10605 native PP512 TG128
on AMD Strix Halo 128GB · llama.cpp b10605 / a130532a / Vulkan
Summary
User reports llama3.2:1b at 158 t/s generation and 7107.3 t/s prompt processing on a GMKtec EVO-X2 with Ryzen AI Max+ 395 and 128 GB unified memory.
Setup is llama-bench build b10605 on the integrated Radeon 8060S via Vulkan, with Q8_0 and the model fitting wholly GPU-side.
The figures are separate synthetic phases: a 512-token prompt evaluation and 128 single-token generation evaluations, not a combined request or 128 sampled output tokens. Five runs per condition were reported, with the highest and lowest dropped and the middle-three median given.