DeepSeek V4 Flash 284B (13B active)

User reports DeepSeek-V4-Flash at 106.1 tok/s single-request decode on 2x RTX Pro 6000 Blackwell (192GB VRAM). Setup is vLLM with FP4+FP8 quantization and FP8 KV cache, no prompt caching and no speculative decoding, 1,024 output tokens per request. Single-request prefill at 8K context is 13,036 tok/s; decode falls to 96.3 tok/s at 1024K context. System throughput with 8 concurrent requests is 367.8 tok/s at 1K context, 170.0 tok/s at 32K and 56.5 tok/s at 128K.