llamaperf

Qwen3 30B (3B active)

on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown

AMD hardware
Oct 13, 2026
Throughput
92.0 t/s gen · 1143.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
Flash Attention
on
System RAM
128 GB

Summary

User reports Qwen3-30B-Instruct-2507 at 92 t/s generation and 1143 t/s prompt processing on an AMD Strix Halo 128GB system with a single Radeon 8060S iGPU. Setup is llama.cpp via RADV with UD-Q4_K_XL, full offload (ngl 999), batch 2048 and flash attention. The figures are separate llama-bench pp512 and tg128 microbenchmarks, not one end-to-end request; the AMDVLK run measured 936.0 t/s prompt and 93.0 t/s generation.