llamaperf

DeepSeek V4 Flash 0731 / Nathan v0.7.5 Vulkan / DSpark fixed 4 / 7680 input

on AMD Ryzen AI MAX+ 395 / Radeon 8060S (Strix Halo gfx1151), 128 GB unified memory · llama.cpp

Oct 13, 2026
Throughput
28.5 t/s gen · 241.1 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-IQ3_XXS (GGUF)
KV cache
Q8
Flash Attention
on
System RAM
128 GB

Summary

User reports DeepSeek V4 Flash at 28.5 t/s generation and 241.1 t/s prompt processing on an AMD Ryzen AI MAX+ 395 with Radeon 8060S graphics and 128 GB unified memory. Setup is llama.cpp (Nathanw1014/strix-halo-llamacpp v0.7.5, Vulkan backend) with UD-IQ3_XXS, K/V q8_0, flash attention and DSpark fixed draft length 4, at 7,680 input tokens. The same run measured 32.28 t/s at 30,720 input tokens and 28.11 t/s at 122,879 input tokens; the headline figures are the 7,680-input point, not a maximum across contexts.