DeepSeek V4 Flash 284B (13B active)
on 4× NVIDIA RTX 3090 · llama.cpp · 204,800 ctx
Oct 3, 2026
Summary
User reports DeepSeek V4 Flash 0731 at 24.48 t/s generation and 300.24 t/s prompt processing on 4x RTX 3090 (WRX80 platform, Threadripper PRO 3975WX, 251GB RAM).
Setup is llama.cpp (club-3090 build) with UD-IQ2_XXS GGUF quant, 204800 token context, MoE cache enabled, speculative decoding on (draft acceptance 0.60833, mean len 4.04), 4 GPUs with PCIe-only interconnect (no NVLink, P2P unreachable).
Model is 284.33B params, 84.62 GiB file at 2.56 BPW; GPUs are power-capped to 250W. Figures are from a single request (n_tokens 2797 prompt, 96 tokens generated).