llamaperf

Ling-3.0 flash

on NVIDIA DGX Spark · vLLM

NVIDIA hardware
Sep 7, 2026
Throughput
40.9 t/s gen
Quant
INT4
VRAM reported
128 GB

Use cases

coding

Summary

User benchmarks Ling-3.0-flash on a DGX Spark at 40.9 t/s on a short coding task. Setup is CUDA graphs with MTP n=1. Prose throughput is 38.7 t/s at 512-token output and 37.3 t/s at 2048-token output. MTP n=2 and n=3 are slower for prose. Acceptance lengths are 1.87 at n=1, 2.39 at n=2 and 2.77 at n=3. Without MTP the baseline is 22.9 t/s with CUDA graphs and 20.8 t/s eager.