llamaperf

GLM-5.1 744B (40B active)

on 8× NVIDIA DGX Spark

Tone: positiveNVIDIA hardware
May 1, 2026
Quant
NVFP4

Summary

User reports GLM-5.1-NVFP4 at 434 GB served across a 16x DGX Spark cluster with unified memory at TP=8. User plans to test DeepSeek and Kimi on the same cluster. User plans a future prefill/decode split using M5 Ultra Mac Studios.