Llama 3.2 3B
on AMD Radeon 8060S integrated GPU (Strix Halo; installed RAM unreported) · llama.cpp b6884 / 229bf6862 / ROCm
Summary
User reports Llama 3.2 3B at 74.3 t/s generation and 661.9 t/s prompt processing on a Minisforum M1-S1 MAX with Ryzen AI Max+ 395 running Ubuntu 24.04.3.
Setup is llama-bench on ROCm with the Q4_0 GGUF, one Radeon 8060S Graphics GPU (gfx1151) and -ngl 999.
The headline pairs separate PP16 and TG64 phases; native values were 661.87 +/- 5.54 t/s and 74.31 +/- 0.05 t/s, with TG128 at 74.13 +/- 0.09 t/s.