llamaperf

Nemotron 3.5 120B (12B active) Super VL

on AMD Strix Halo 128GB · Atlas Inference · 32,768 ctx

Tone: positiveAMD hardware
Oct 16, 2026
Throughput
28.1 t/s gen
Quant
NVFP4 (NVFP4)
System RAM
128 GB

Use cases

agentictool-usevision

Summary

User reports Nemotron 3.5 Super VL 120B-A12B at 28.1 tok/s on Strix Halo 128GB (Framework Desktop, Ryzen AI Max+ 395, gfx1151) under Linux with ROCm 7.13. Setup is Atlas Inference with NVFP4 weights and a LiLiCorr drafter (gamma 8) at 32K context with prefix caching on. Windows 11 gives 27.5 tok/s with the drafter and 18.4 tok/s without; Linux gives 17.8 tok/s without. Speculative decoding is lossless, byte-identical to plain decoding across all 995 BFCL prompts. BFCL ST-995 scores 88.14 and MLPerf Edge Agentic 0.611 across 1,007 recorded turns on both platforms. Text-only on AMD for now; vision runs on DGX Spark.