llamaperf

DeepSeek V4 Flash 284B (13B active)

on 2× AMD Radeon AI PRO R9700 32GB · llama.cpp

Tone: mixedAMD hardware
Sep 23, 2026
Throughput
24.1 t/s gen · 154.7 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-IQ4_NL (GGUF)

Summary

User compares ROCm and Vulkan performance for DeepSeek V4 Flash 0731 and Qwen 3.8 Flash Next on a Radeon AI PRO R9700 32GB plus Strix Halo in llama.cpp. DeepSeek V4 Flash 0731 with UD-IQ4_NL quant and a DSpark Q2K-Q4K drafter on ROCm reached 154.67 t/s prompt and 24.07 t/s generation on a 40,180-token needle prompt; Vulkan reached 131.97 t/s prompt and 20.44 t/s generation. Qwen 3.8 Flash Next with UD-Q4_K-XL and no speculative decoding on ROCm reached 566.10 t/s prompt and 17.96 t/s generation; Vulkan reached 477.33 t/s prompt and 18.99 t/s generation. User concludes ROCm still wins for DeepSeek while Vulkan has closed the gap, and for Qwen ROCm leads on prompt processing but Vulkan leads on token generation.