llamaperf

DeepSeek V4.1 Flash 552B (16B active)

on 2× NVIDIA DGX Spark · TensorFold

Tone: mixedNVIDIA hardware
Oct 18, 2026
Throughput
56.8 t/s gen
Quant
EXL3 2.9bpw (EXL3)

Use cases

codingagentictool-uselong-context

Summary

User reports DeepSeek-V4.1-Flash-1017 at 56.8 tok/s decode on text and 92.2 tok/s on code with TensorFold on two DGX Spark, TP=2 over the CX7 cable. Setup is TensorFold with EXL3 2.9bpw weights and 1M context, using a speculative two-node decoder; the same pair with the vLLM kit reached 27.0 tok/s text and 39.9 tok/s code. Four concurrent code requests total 140 tok/s, and a 64K-token needle test took 35.9 s versus 80.4 s on the kit. Long-prompt prefill is 30-37% below the published numbers (1,707 vs 2,421 tok/s at 32K), and the first long prompt after a start costs about 6 s extra.