llamaperf

Muse Glimmer-30B / Vulkan RADV native PP512/TG128

on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown

AMD hardware
Oct 13, 2026
Throughput
7.3 t/s gen · 234.1 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q8_K_XL (GGUF)
Flash Attention
on
System RAM
128 GB

Summary

User reports Muse-Glimmer-30B at 7.3 t/s generation and 234.1 t/s prompt processing on a single Radeon 8060S iGPU in an AMD Strix Halo system with 128 GB unified memory. Setup is llama.cpp with the Unsloth UD-Q8_K_XL quant, full offload, batch 2048 and flash attention, run as separate llama-bench pp512 and tg128 microbenchmarks rather than one end-to-end request. The main table figure is rounded; the source narrative gives approximately PP234 and TG7.25. A separate DFlash server test reports 13.53 t/s, which is not tg128 and is not part of this row.