DeepSeek V4 Flash 284B (13B active)
on AMD Strix Halo 128GB · 8,192 ctx
Summary
User reports DeepSeek V4 Flash on Strix Halo at 32.0 tok/s decode with DSpark speculative draft and 25.31 tok/s autoregressive.
Setup is ROCmFP2 mixed precision at roughly 2.88 bits per parameter, with a Q4RMFP4 draft model. Prefill runs at 245 tok/s sparse.
The user compares this to LocalMaxxing entries of 18.99 tok/s for HipFire and 15.6 tok/s for DwarfStar.