Nemotron 3 Nano 30B-A3B / Vulkan b10605 native PP512 TG128
on AMD Strix Halo 128GB · llama.cpp b10605 / a130532a / Vulkan
Summary
User reports Nemotron-3-Nano-30B at 69.6 t/s generation and 921.4 t/s prompt processing on a GMKtec EVO-X2 with Ryzen AI Max+ 395, Radeon 8060S iGPU and 128 GB unified memory.
Setup is llama-bench build b10605 on Vulkan with Q4_K_M, run as separate 512-token prompt and 128-token generation phases.
The figures are the median of five runs per condition with highest and lowest dropped; the model fits wholly GPU-side, and batch, thread and KV cache settings are not reported.