DeepSeek V4.1 Flash 552B (16B active)
on 2× NVIDIA DGX Spark · TensorFold
Use cases
codingagentictool-uselong-context
Summary
User reports DeepSeek-V4.1-Flash-1017 at 56.8 tok/s decode on text and 92.2 tok/s on code with TensorFold on two DGX Spark, TP=2 over the CX7 cable.
Setup is TensorFold with EXL3 2.9bpw weights and 1M context, using a speculative two-node decoder; the same pair with the vLLM kit reached 27.0 tok/s text and 39.9 tok/s code.
Four concurrent code requests total 140 tok/s, and a 64K-token needle test took 35.9 s versus 80.4 s on the kit. Long-prompt prefill is 30-37% below the published numbers (1,707 vs 2,421 tok/s at 32K), and the first long prompt after a start costs about 6 s extra.