llamaperf

DeepSeek V4 Flash 284B (13B active)

on 8× AMD Radeon AI PRO R9700 32GB · llama.cpp

Tone: mixedAMD hardware
Oct 9, 2026
Throughput
40.0 t/s gen
System RAM
256 GB
VRAM reported
400 GB

Summary

User reports DeepSeek V4 Flash reaching a peak of 40 t/s generation on 8x Radeon AI PRO R9700 under llama.cpp, but the run froze after 200-300 tokens. Setup is llama.cpp on 8x R9700 with 256GB system RAM and roughly 400GB total VRAM; the user notes llama.cpp on many GPUs was very slow, possibly due to ROCm. The user also runs MiniMax M2.7 (MXFP4_16, iq4_nl) on 8x R9700 and Qwen3-27b-BF16 on 4x7900xtx under vLLM, and gave up on a REAP GLM-5.1 50% build due to vLLM errors.