DeepSeek V4 Flash 284B (13B active)
on 2× NVIDIA RTX 3080 20GB · llama.cpp · 131,072 ctx
Sep 7, 2026
Summary
User reports 17.53 t/s generation and 273.21 t/s prefill at 128k context on 2x RTX 3080 20GB with 64GB DDR5.
Setup is the llama.cpp fork by fairydreaming with an 86.7 GB model, --n-cpu-moe 28 and split-mode layer.