llamaperf

DeepSeek V4 Flash 0731 / ROCm PR729 / plain autoregressive / 7680 input

on AMD Ryzen AI MAX+ 395 / Radeon 8060S (Strix Halo gfx1151), 128 GB unified memory · Lucebox · 131,072 ctx

Oct 13, 2026
Throughput
21.2 t/s gen · 321.5 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
ROCmFPX-MIX-STRIX (GGUF)
System RAM
128 GB

Summary

User reports DeepSeek V4 Flash at 21.2 t/s generation and 321.5 t/s prompt processing on one AMD Ryzen AI MAX+ 395 with Radeon 8060S (gfx1151) and 128 GB unified memory. Setup is Lucebox PR 729 on ROCm/HIP 7.2.4 with ROCmFPX-MIX-STRIX, K/V q4_0, fused decode and verify with F16 KV, expert top-k 6, sparse prefill, and a 131,072-token allocation; speculation is disabled with no drafter loaded. The headline figures are the 7,680-input point of a native PP/TG curve, not a maximum across contexts; the same curve gives 318.0/18.4 at 30,720 input and 287.4/12.9 at 122,879 input.