DeepSeek V4 Flash 284B (13B active)
on 8× NVIDIA RTX 5090 · 250,000 ctx
Summary
User reports 2000+ t/s aggregate and 30-40 t/s per session across 50 concurrent sessions on 8x RTX 5090.
Setup is the REAP mxfp4 image with 250k KV per session.
on 8× NVIDIA RTX 5090 · 250,000 ctx