Nemotron 3-Super-120B-A12B / Vulkan RADV native benchmark
on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown
Summary
User reports Nemotron-3-Super-120B-A12B at 10.2 t/s generation and 196 t/s prompt processing on an AMD Strix Halo 128GB system with one Radeon 8060S gfx1151 integrated GPU.
Setup is native llama-bench with Unsloth UD-Q4_K_XL, full GPU offload ngl 999, batch 2048, 32 threads and flash attention 1.
The figures are separate pp512 and tg128 phases, not simultaneous 512-in/128-out throughput; the same model also ran at 9.86 t/s TG and 139 t/s PP on the AMDVLK backend.