llamaperf

Llama 3.1 8B

on AMD Radeon 8060S integrated GPU (Strix Halo; installed RAM unreported) · llama.cpp b7642 / e75ee110 / Vulkan

Oct 13, 2026
Throughput
44.1 t/s gen · 892.5 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
Flash Attention
off

Summary

User reports Llama 3.1 8B at 44.1 t/s generation and 892.5 t/s prompt processing on a Minisforum MS-S1 MAX with an AMD Ryzen AI Max+ 395 and integrated Radeon 8060S. Setup is llama.cpp build 7642 with the Q4_K_M GGUF, flash attention off, integer dot product disabled, 99 layers offloaded to one Vulkan0 device, and 64G of system RAM allocated to the GPU. The figures are separate llama-bench PP512 and TG128 phases, not one 512-input/128-output request, with 4.58 GiB model size and f16 K/V cache at prepared depth 0.