Nemotron 3.5 120B (12B active) Super VL
on AMD Strix Halo 128GB · Atlas Inference · 32,768 ctx
Use cases
agentictool-usevision
Summary
User reports Nemotron 3.5 Super VL 120B-A12B at 28.1 tok/s on Strix Halo 128GB (Framework Desktop, Ryzen AI Max+ 395, gfx1151) under Linux with ROCm 7.13.
Setup is Atlas Inference with NVFP4 weights and a LiLiCorr drafter (gamma 8) at 32K context with prefix caching on. Windows 11 gives 27.5 tok/s with the drafter and 18.4 tok/s without; Linux gives 17.8 tok/s without.
Speculative decoding is lossless, byte-identical to plain decoding across all 995 BFCL prompts. BFCL ST-995 scores 88.14 and MLPerf Edge Agentic 0.611 across 1,007 recorded turns on both platforms. Text-only on AMD for now; vision runs on DGX Spark.