llamaperf

Qwen3 30B (3B active) Thinking-2507

on AMD MI50 32GB · llama.cpp-gfx906

AMD hardware
Oct 3, 2026
Throughput
63.0 t/s gen · 1224.1 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_0 (GGUF)
KV cache
Q8_0

Summary

User benchmarks Qwen3-30B-A3B-Thinking-2507-Q4_0 on an AMD MI50 using a specialized llama.cpp-gfx906 fork with flash attention and Q8_0 KV cache quantization. Prompt processing reaches 1224.07 t/s at 512 tokens and generation 63.00 t/s at 128 tokens. Without KV quantization, generation is 79.92 t/s but prompt processing drops to 1167.28 t/s at 512 tokens. The fork is optimized for D=128 head dimension models and reports 5-11% prompt processing improvement from flash attention.