llamaperf

DeepSeek V4 Flash 285B (13B active) Vision-Exp

on 10× NVIDIA RTX 3090 · vLLM · 1,000,000 ctx

Tone: positiveNVIDIA hardware
Sep 9, 2026
Throughput
60.0 t/s gen
Quant
FP4
KV cache
FP8
VRAM reported
24 GB

Summary

User reports a 285B MoE at 60+ t/s on 10 RTX 3090s and 120+ t/s on 12 RTX 3090s. Setup is FP4 experts with FP8 attention and 157GB of weights, using TP2xPP5 on 10 GPUs at a 240W cap and TP4xPP3 on 12 GPUs. The 60+ t/s figure is on 10 GPUs. Context runs to 1M without offload and 4M with RAM offload, with long-context prefill around 3500 t/s when batched. Vision, speculative decoding and tool calls work. A Docker image and repo are provided.