llamaperf

DeepSeek V4.1 Flash 552B (16B active)

on 4× NVIDIA DGX Spark · TensorFold · 1,000,000 ctx

Tone: positiveNVIDIA hardware
Oct 26, 2026
Throughput
106.0 t/s gen
Quant
EXL3 3.5bpw (EXL3)
System RAM
128 GB

Use cases

codingcreative-writing

Summary

User reports DeepSeek V4.1 Flash at 106 t/s per stream at concurrency 1 on four DGX Sparks, averaging 93 t/s aggregate across eight categories. Setup is TensorFold's Zig engine with an EXL3 3.5bpw pack, 1M context, a 2M-position KV pool, DSpark speculative drafts on and tensor parallel across all four GB10 nodes over RoCE v2. The sweep runs to 16 streams: per-stream decode falls to 20 t/s while aggregate rises to 250 t/s at C16. Coding reaches 139 t/s per stream at C1 and 343 t/s aggregate at C16; prose 81 and 224. Cold prefill was skipped, previously measured at 1.9-2.3K tok/s.