llamaperf

Nemotron 3 Nano 4B / Vulkan b10605 native PP512 TG128

on AMD Strix Halo 128GB · llama.cpp b10605 / a130532a / Vulkan

AMD hardware
Oct 13, 2026
Throughput
69.5 t/s gen · 1392.6 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
System RAM
128 GB

Summary

User reports Nemotron-3-Nano-4B at 69.5 t/s generation and 1392.6 t/s prompt processing on a GMKtec EVO-X2 with Ryzen AI Max+ 395, Radeon 8060S iGPU and 128 GB unified memory. Setup is llama-bench build b10605 with Q4_K_M over Vulkan, run as separate 512-token prompt and 128-token generation phases rather than one request. The source reports five runs per condition, dropping the highest and lowest for a middle-three median, and says the model fits wholly GPU-side; batch, thread and context settings are not reported.