llamaperf

Phi 4-mini / Vulkan b10605 native PP512 TG128

on AMD Strix Halo 128GB · llama.cpp b10605 / a130532a / Vulkan

AMD hardware
Oct 13, 2026
Throughput
79.7 t/s gen · 2368.4 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
System RAM
128 GB

Summary

User reports phi4-mini Q4_K_M at 79.7 t/s generation and 2368.4 t/s prompt processing on a GMKtec EVO-X2 with Ryzen AI Max+ 395, Radeon 8060S iGPU and 128 GB unified memory. Setup is llama-bench build b10605 on Vulkan, with the model fitting wholly GPU-side. The figures are separate synthetic phases: a 512-token prompt evaluation and a 128 single-token generation evaluation, not a combined request or 128 sampled output tokens. Five runs per condition were reported with the middle-three median, and no TTFT was measured.