DeepSeek V4 Flash 284B (13B active)
on RTX 4090D 48GB · vLLM · 262,144 ctx
Summary
User reports running on two RTX 4090D 48GB GPUs, 96 GB total, with a p2p patch.
Setup includes Blackwell-only kernels re-implemented in Triton for sm89, and llama.cpp with the IQ2XXS quant, 262k context and a q8_0 KV cache.
The user mentions a 2-3x speedup for parallel agentic workflows versus llama.cpp.