llamaperf

Step-3.5-Flash / b8118 Vulkan / PP512 TG128 at prepared depth8000

on AMD Radeon 8060S gfx1151 (Strix Halo; CPU SKU and installed RAM unknown) · llama.cpp

Oct 13, 2026
Throughput
24.3 t/s gen · 143.7 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
Q3_K_M (GGUF)
KV cache
Q8
Flash Attention
on
MTP (Multi-Token Prediction)
off

Summary

User reports Step-3.5-Flash Q3_K_M at 24.3 t/s generation and 143.7 t/s prompt processing on a single Radeon 8060S gfx1151 device. Setup is llama.cpp build b8118 with Q3_K_M, q8_0 KV cache, -ngl 999, -fa 1 and depth 8000, run on the Vulkan/RADV BLAS arm. The headline pair comes from that same arm, with TG128 24.31 ± 0.81 tok/s and PP512 143.69 ± 1.41 tok/s; the ROCm/HIP arm measured 18.30 ± 1.13 and 158.18 ± 1.89 tok/s.

Compare this run

Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.

Every Step-3.5-Flash report →