llamaperf
Sep 7, 2026
Throughput
38.7 t/s gen
Quant
INT4

Summary

User reports Ling-3.0-flash (124B) at 38.7 tok/s on the official INT4 quant on one DGX Spark, from benchmarks posted by sudoingX on X. The community GGUF reaches 35.2 tok/s, and the result is 2.4x what DeepSeek V4 Flash does on the same machine. The benchmarker first posted that the official quants do not run on a single Spark, then corrected that two days later.