DeepSeek V4 Flash 284B (13B active)
on 2× NVIDIA RTX 3090 · llama.cpp · 65,536 ctx
Oct 3, 2026
Summary
User reports DeepSeek V4 Flash at ~1.78 t/s generation and ~29.8 t/s prompt processing on dual RTX 3090s with 64GB DDR4 and 78GB swap.
Setup is llama.cpp with UD-Q8_K_XL GGUF weights, q8_0 KV cache, 65536-token context, 11 GPU layers and tensor split 1,1.
The user notes the generation figure used only GPU and RAM with no swap, and that prefill is fast because the GPUs handle it.