DeepSeek V4 Flash 284B (13B active)
on 4× NVIDIA RTX 3060 12GB · llama.cpp · 368,640 ctx
Sep 7, 2026
Summary
User reports DeepSeek-V4-Flash-0731 at 10.1 t/s generation and 99.4 t/s prompt processing on 4x RTX 3060 12GB at 368k context.
Setup is llama.cpp build b10181 with a Q8_0 KV cache and a microbatch size of 2048, with the 144 GiB GGUF mostly in 128GB of system RAM.
Runs at 376832 and 360448 context gave similar speeds.