DeepSeek V4 Flash 285B (13B active) Vision-Exp
on 10× NVIDIA RTX 3090 · vLLM · 1,000,000 ctx
Sep 9, 2026
Summary
User reports a 285B MoE at 60+ t/s on 10 RTX 3090s and 120+ t/s on 12 RTX 3090s.
Setup is FP4 experts with FP8 attention and 157GB of weights, using TP2xPP5 on 10 GPUs at a 240W cap and TP4xPP3 on 12 GPUs.
The 60+ t/s figure is on 10 GPUs. Context runs to 1M without offload and 4M with RAM offload, with long-context prefill around 3500 t/s when batched. Vision, speculative decoding and tool calls work. A Docker image and repo are provided.