DeepSeek V4.1 Flash 552B (16B active)
on 6× NVIDIA RTX Pro 6000 Blackwell · 1,024 ctx
Summary
User benchmarks DeepSeek V4.1 Flash at 104.86 tokens/s decode on six RTX PRO 6000 Blackwell 96 GB cards.
Setup uses B12X linears and experts with PCIe IPC, prefill budget 1536, concurrency 1, no CPU offload. Decode holds 103.37 tokens/s at 32K and 103.84 tokens/s at 128K; TTFT is 2.383 s at 32K and 9.848 s at 128K.
The exact 1M-token test (1,048,448 input, 128 forced output) completed in 170.08 s, down from 187.10 s. The final profile shortened 128K TTFT by 15.3%. Server decode rates were 101.5-103.1 tokens/s against client estimates of 103-105 tokens/s.