llamaperf

DeepSeek V4 Flash 284B (13B active)

on 2× AMD Radeon AI PRO R9700 32GB · affinity · 262,144 ctx

Tone: positiveAMD hardware
Sep 27, 2026
Throughput
40-50 t/s gen · 1260-1360 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
2.875bpw
System RAM
192 GB
VRAM reported
32 GB

Use cases

long-contextagentictool-use

Summary

User reports DeepSeek-V4-Flash-0731 at ~40–50 tok/s on long structured answers and ~31–35 tok/s on free-form prose and reasoning on two Radeon AI PRO R9700 32GB cards with 192 GB system RAM. Setup is the affinity engine with a 2.875 bpw quant, 262K context fully allocated at load, and a DeepSeek-native speculative draft. Prefill is ~1,260–1,360 tok/s at 4K–64K context. Needle-in-a-haystack passed 3/3 at 4K/16K/64K, and a 15-turn agentic task passed every check. The user notes RDNA4 (gfx1201) only, two cards max, and ~64 GB+ RAM needed for experts that don't fit on the cards. An experimental DeepSeek-V4.1-Flash branch runs at only ~14 tok/s on two cards.