DeepSeek V4 Flash 284B (13B active)
on NVIDIA RTX Pro 6000 Blackwell · vLLM-Moet · 130,000 ctx
Summary
User reports DeepSeek V4 Flash at 100-130 t/s on a single RTX 6000 Pro.
Setup is vLLM-Moet at 130K context, requiring about 150GB RAM for loading.