Nemotron 3.5 Lightning 30B (3B active)
M6 32GB · LM Studio · 32,768 ctx
- generation:
- 42.3 tokens/s
- quant:
- UD-Q3_K_XL (GGUF)
User reports Nemotron 3.5 Lightning 30B-A3B at 42.3 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with its llama.cpp GGUF backend, UD-Q3_K_XL quant, and 32,768 tokens of loaded context. The 42.3 t/s is the median of three English-prose runs (Ruhr economy prompt), client-observed streaming decode throughput, not an overall mean or prefill rate.