Ornith1.5 35B (3B active)

User reports Ornith-1.5-35B-A3B at 79 tok/s single-stream on one NVIDIA DGX Spark (128GB unified memory). Setup is vLLM 0.24 with the official 4-bit NVFP4 checkpoint (about 22 GiB) and multi-token prediction speculative decoding, serving the full 262K context. At 20 concurrent users each stream gets about 25 tok/s, 490 tok/s total; GPU memory utilization had to be capped at 0.70 and throughput dropped past 20 users. Reasoning scores cited: MATH-500 97%, GSM8K 98%, MMLU-Pro 81%.