DeepSeek V4 Flash 284B (13B active)
on 3× NVIDIA RTX 3090 · llama.cpp · 262,144 ctx
Use cases
coding
Summary
User reports DeepSeek V4 Flash at 37.91 t/s prompt processing and 9.07 t/s generation on two RTX 3090 24GB cards and one RTX 5090 32GB card, 80GB VRAM total, with 128GB DDR4 RAM.
Setup is llama.cpp server with the unsloth Q8_K_XL GGUF, tensor splitting, and MoE layers offloaded to CPU.
User says performance is better than Qwen 3.5 v2 on coding tasks and asks for speed improvement suggestions.