Nemotron 3-Nano-30B-A3B / Vulkan RADV native PP512/TG128
on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown
Summary
User reports Nemotron-3-Nano-30B-A3B at 68 t/s generation and 1106 t/s prompt processing on an AMD Strix Halo 128GB system with a single Radeon 8060S iGPU.
Setup is llama.cpp via RADV with UD-Q4_K_XL, full offload, batch 2048 and flash attention, using llama-bench pp512 and tg128.
These are separate 512-token prompt and 128-token generation microbenchmarks, not one end-to-end request; the AMDVLK arm reached 776.0 and 65.0 t/s.