DeepSeek V4 Flash 284B (13B active)
on NVIDIA RTX A6000 48GB · 1,000,000 ctx
Summary
User reports DeepSeek-V4-Flash-0731 UD-Q8_K_XL at a steady 17.20 t/s on an RTX A6000 48GB.
Setup is an AMD EPYC 74F3 24-core with 8 channel 3200 DDR4.
Prompt processing is in the high 70 t/s, down to mid 30 t/s at 300k context. The user says 48GB VRAM is enough for the full 1mil context but prompt processing would be very slow.