llamaperf

DeepSeek V4 Flash 0731 / ROCm PR729 / DSpark adaptive q2-q5 / 7680 input

on AMD Ryzen AI MAX+ 395 / Radeon 8060S (Strix Halo gfx1151), 128 GB unified memory · Lucebox · 131,072 ctx

Oct 13, 2026
Throughput
41.9 t/s gen · 283.3 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
ROCmFPX-MIX-STRIX (GGUF)
System RAM
128 GB

Summary

User reports DeepSeek V4 Flash at 41.9 t/s generation and 283.3 t/s prompt processing on an AMD Ryzen AI MAX+ 395 with Radeon 8060S (gfx1151) and 128 GB unified memory, one Strix Halo GPU. Setup is Lucebox PR 729 on ROCm/HIP 7.2.4 with ROCmFPX-MIX-STRIX, K/V q4_0, fused decode and verify with F16 KV, expert top-k 6, sparse prefill, and DSpark adaptive q2-q5 speculation, at a 131,072-token allocation. The headline figures are the 7,680-input point of a native PP/TG curve, not a maximum across contexts; the same curve gives 306.6/41.4 at 30,720 input and 283.9/38.0 at 122,879 input.