Llama 3.1 8B
on AMD Radeon 8060S integrated GPU (Strix Halo; installed RAM unreported) · llama.cpp b7642 / e75ee110 / Vulkan
Summary
User reports Llama 3.1 8B at 44.1 t/s generation and 892.5 t/s prompt processing on a Minisforum MS-S1 MAX with an AMD Ryzen AI Max+ 395 and integrated Radeon 8060S.
Setup is llama.cpp build 7642 with the Q4_K_M GGUF, flash attention off, integer dot product disabled, 99 layers offloaded to one Vulkan0 device, and 64G of system RAM allocated to the GPU.
The figures are separate llama-bench PP512 and TG128 phases, not one 512-input/128-output request, with 4.58 GiB model size and f16 K/V cache at prepared depth 0.