Nemotron 3.5 Lightning 30B (3B active)

User reports the current vLLM setup for Nemotron 3.5 Lightning 30B-A3B on a Jetson AGX Orin 64GB runs at around 80 tok/s while occupying roughly 62 GB of unified memory. The post is a benchmark plan: it proposes comparing SGLang and llama-server against the vLLM baseline, measuring cold and warm-prefix TTFT, decode tok/s, and resident memory across 4K to 128K prompts, a 32K shared-prefix four-agent workload, and constrained budgets of 32, 40 and 48 GB. No SGLang or llama-server results are given yet; the 80 tok/s figure is the existing vLLM baseline.