llamaperf
Sep 7, 2026
Throughput
40.0 t/s gen · 1800.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Use cases

agentic

Summary

User reports DeepSeek V4 Flash at 1800 t/s prefill and 40 t/s generation on two DGX Spark units. User praises the scalability via ConnectX and the power efficiency.