PP512 TG128 at prepared depth8000

on AMD Radeon 8060S gfx1151 (Strix Halo; CPU SKU and installed RAM unknown) · llama.cpp

Oct 13, 2026

Throughput

23.7 t/s gen · 192.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

UD-Q8_K_XL (GGUF)

KV cache

Flash Attention

MTP (Multi-Token Prediction)

off

Summary

User reports GLM-4.7 at 23.7 t/s generation and 192.8 t/s prompt processing on a single Radeon 8060S gfx1151 device. Setup is llama.cpp build b8118 with UD-Q8_K_XL, q8_0 KV cache, -ngl 999, -fa 1, -ub 2048 -b 2048, and --mmap 0 -dio 1 on the ROCm/HIP arm. The headline pair comes from the same ROCm/HIP run, with exact rates 23.66 ± 1.80 t/s TG128 and 192.79 ± 3.02 PP512 at depth 8000; the Vulkan arm measured 21.14 ± 1.39 and 163.58 ± 1.83.