llamaperf

GLM-5.2

on NVIDIA DGX Spark · vLLM · 131,072 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
14.5-15.2 t/s gen · 512.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
NVFP4
KV cache
fp8

Use cases

long-contextcoding

Summary

User reports GLM-5.2 NVFP4 at about 15 t/s decode on short context and about 13 t/s at long context on a 4x DGX Spark setup, with about 512 t/s prefill. Setup is 128K context with TP4/PP1/DCP4/MTP1 and an fp8 KV cache.