llamaperf

Qwen3 30B (3B active)

on AMD Strix Halo 128GB · llama.cpp

AMD hardware
Oct 9, 2026
Throughput
86.1 t/s gen · 1142.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
System RAM
128 GB

Summary

User reports Qwen3 30B-A3B MoE at 86.1 t/s token generation on a Strix Halo 128GB (Ryzen AI Max+ 395, Radeon 8060S). Setup is llama.cpp with Q4_K_M GGUF, Vulkan RADV backend, 120W power profile, single host (GMKtec EVO-X2). Prompt processing measured at 1142 t/s (pp512). The repo also lists MiniMax M2.5 Q3_K_M at 32.8 t/s, Qwen3-Coder-Next 80B-A3B Q4_K_M at 42.7 t/s, GPT-OSS 120B Q4_K_M at 53.4 t/s and Nemotron-3 Nano 30B-A3B MXFP4 at 61.5 t/s on the same hardware.