DeepSeek V4 Flash 284B (13B active)
on AMD Strix Halo 128GB · llama.cpp · 16,384 ctx
Use cases
agenticlong-context
Summary
User reports DeepSeek-V4-Flash-0731 (284B MoE, 13B active) at 28.91 t/s generation and 261.7 t/s prompt processing on a single AMD Ryzen AI MAX+ 395 with 128GB unified memory.
Setup is a llama.cpp fork (Nathanw1014/llama.cpp) with Vulkan/RADV backend, UD-IQ2_XXS quant (2.06 bpw), DSpark draft model at n=3, 16384 context, 120 GiB GTT limit.
Best result is IQ2_XXS + DSpark n=3 at 28.91 t/s, reaching 90% of Lucebox's 32.0 t/s with 6 experts instead of 4. The fork beats upstream by 49% on prompt processing at 8192 context. IQ2 with draft model sits at the memory limit and is a measurement setup, not a production state.