llamaperf

GLM-5.3 320B (18B active) Flash

on 2× NVIDIA DGX Spark · 1,500 ctx

Tone: positiveNVIDIA hardware
Oct 8, 2026
Throughput
66.0 t/s gen · 1376.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
NVFP4 (NVFP4)

Use cases

codingagenticvision

Summary

User reports GLM-5.3 Flash NVFP4 on two DGX Sparks at a 66.0 t/s mean decode across a task battery, with prefill at 1376 t/s on a 1.5K prompt. Setup is the GLM-5.3-Flash-NVFP4-DFlash2 recipe with DFlash2 speculative decoding, 3.55 of 8 draft tokens accepted per step, single request, and a KV pool of 560,362 tokens. Battery tasks range from 37.1 t/s on prose to 97.2 on bulk SQL inserts, and prefill holds near 1,576 t/s at 32K and 128K. The previous DeepSeek V4 Flash setup averaged 61.5 t/s on the same battery. A 40-minute soak at c4 served 503 requests with 0 errors at 83.6 t/s aggregate.