Llama 3.3 70B / Vulkan b10605 native PP512 TG128
on AMD Strix Halo 128GB · llama.cpp b10605 / a130532a / Vulkan
Summary
User reports llama3.3:70b at 5.3 t/s generation and 102 t/s prompt processing on a GMKtec EVO-X2 with Ryzen AI Max+ 395, integrated Radeon 8060S and 128 GB unified memory.
Setup is llama-bench build b10605 with Q4_K_M over Vulkan, run on the single integrated GPU.
The figures are separate synthetic phases: a 512-token prompt evaluation at 102.0 t/s and a 128 single-token generation evaluation at 5.3 t/s, not a combined request or 128 sampled output tokens. Five runs per condition were reported with the middle-three median, and no TTFT was measured.