DeepSeek V4 Flash 284B (13B active)
on 4× NVIDIA RTX 3090 · llama.cpp
Oct 3, 2026
Summary
User asks which inference engine is fastest for a full quant on 96GB of VRAM, with 4x RTX 3090 and 256GB of 8-channel DDR4.
They report getting at most 6 t/s on short prompts with llama.cpp CUDA.
No model, quant, or context length is named.