Step-3.5-Flash / b8118 Vulkan / PP512 TG128 at prepared depth8000
AMD Radeon 8060S gfx1151 (Strix Halo; CPU SKU and installed RAM unknown) · llama.cpp
- generation:
- 24.3 tokens/s
- prompt processing (prefill):
- 143.7 tokens/s
- quant:
- Q3_K_M (GGUF)
- kv:
- Q8
- flash attention:
- on
- mtp (multi-token prediction):
- off
User reports Step-3.5-Flash Q3_K_M at 24.3 t/s generation and 143.7 t/s prompt processing on a single Radeon 8060S gfx1151 device. Setup is llama.cpp build b8118 with Q3_K_M, q8_0 KV cache, -ngl 999, -fa 1 and depth 8000, run on the Vulkan/RADV BLAS arm. The headline pair comes from that same arm, with TG128 24.31 ± 0.81 tok/s and PP512 143.69 ± 1.41 tok/s; the ROCm/HIP arm measured 18.30 ± 1.13 and 158.18 ± 1.89 tok/s.