Step-3.5-Flash / b8118 Vulkan / PP512 TG128 at prepared depth8000
on AMD Radeon 8060S gfx1151 (Strix Halo; CPU SKU and installed RAM unknown) · llama.cpp
Summary
User reports Step-3.5-Flash Q3_K_M at 24.3 t/s generation and 143.7 t/s prompt processing on a single Radeon 8060S gfx1151 device.
Setup is llama.cpp build b8118 with Q3_K_M, q8_0 KV cache, -ngl 999, -fa 1 and depth 8000, run on the Vulkan/RADV BLAS arm.
The headline pair comes from that same arm, with TG128 24.31 ± 0.81 tok/s and PP512 143.69 ± 1.41 tok/s; the ROCm/HIP arm measured 18.30 ± 1.13 and 158.18 ± 1.89 tok/s.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.