DeepSeek V4 Flash 284B (13B active)
on 2× AMD Radeon AI PRO R9700 32GB · affinity · 262,144 ctx
Use cases
long-contextagentictool-use
Summary
User reports DeepSeek-V4-Flash-0731 at ~40–50 tok/s on long structured answers and ~31–35 tok/s on free-form prose and reasoning on two Radeon AI PRO R9700 32GB cards with 192 GB system RAM.
Setup is the affinity engine with a 2.875 bpw quant, 262K context fully allocated at load, and a DeepSeek-native speculative draft.
Prefill is ~1,260–1,360 tok/s at 4K–64K context. Needle-in-a-haystack passed 3/3 at 4K/16K/64K, and a 15-turn agentic task passed every check. The user notes RDNA4 (gfx1201) only, two cards max, and ~64 GB+ RAM needed for experts that don't fit on the cards. An experimental DeepSeek-V4.1-Flash branch runs at only ~14 tok/s on two cards.