DeepSeek V4 Flash 284B (13B active)

User reports DeepSeek-V4-Flash on two ASUS GX10 (DGX Spark) units connected via RoCE with TP=2, decoding 49.4 t/s at 4K context, 43.0 t/s at 16K, 37.9 t/s at 32K, 42.5 t/s at 128K and 39.8 t/s at 256K, with prefill of 2050 t/s, 2150 t/s, 2130 t/s, 1920 t/s and 1680 t/s at the same context lengths. Setup is a vLLM fork from local-inference-lab with MXFP8 x MXFP4 weights. At concurrency 4 and 128K context the aggregate is about 40-42 t/s. The KV cache holds up to about 1M tokens of context, though the user typically runs 256K. The user reports roughly 280W at maximum load and says the model beats M2.7 and Stepfun 3.7 on a private benchmark, praising its high-context retrieval and reasoning. A Docker compose file is provided.