PP512 TG128 at prepared depth8000

on AMD Radeon 8060S gfx1151 (Strix Halo; CPU SKU and installed RAM unknown) · llama.cpp

Oct 13, 2026

Throughput

36.0 t/s gen · 267.3 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

UD-Q4_K_XL (GGUF)

KV cache

Flash Attention

MTP (Multi-Token Prediction)

off

Summary

User reports GLM-4.7 at 36 t/s generation and 267.3 t/s prompt processing on a single Radeon 8060S gfx1151 device. Setup is llama.cpp b8118 with UD-Q4_K_XL and q8_0 KV cache, 16 CPU threads, -ngl 999, -fa 1, -ub 2048 -b 2048, no speculative draft. The headline figures are the ROCm/HIP arm, measured as PP512 267.25 ± 1.56 and TG128 35.95 ± 3.53 tok/s at depth 8000; the 8000-token prefix is excluded from timing.