llamaperf
Sep 7, 2026
Throughput
40.2 t/s gen
Quant
Q5_K_M (GGUF)

Summary

User reports Ling-3.0-flash at 40.2 tok/s single stream decode with the Q5_K_M quant on one DGX Spark, from benchmarks posted by sudoingX on X. Setup is the community GGUF quant ladder, with 5.1B active out of 124B parameters. Q4_K_M reaches 38.2 tok/s and Q6_K 32.0 tok/s. DeepSeek V4 Flash measured 16.5 tok/s on the same box.