DeepSeek V4 Flash 284B (13B active)
on AMD Strix Halo 128GB · llama.cpp · 131,072 ctx
Summary
User reports DeepSeek V4 Flash 0731 at 26.76 t/s sustained decode and 236 t/s prefill on a Strix Halo (Ryzen AI MAX+ 395, Radeon 8060S).
Setup is llama.cpp Vulkan v0.6.1 with DSpark speculative decoding, a bf16 draft model, and a q8_0 KV cache.
The user compares this with the DGX Spark and notes that q8_0 KV beats f16, the draft must be bf16, Vulkan beats ROCm, ubatch tops out at 2048, and a v0.6 regression is fixed in v0.6.1.