llamaperf

Qwen3-Coder 30B (3B active)

on AMD Strix Halo 128GB · llama.cpp · 8,192 ctx

Tone: positiveAMD hardware
Oct 9, 2026
Throughput
70.3 t/s gen
Quant
Q4_K_M (GGUF)
Rating
5/5
System RAM
124 GB

Use cases

coding

Summary

User reports Qwen3-Coder-30B-A3B-Instruct at 70.25 t/s generation on an AMD Strix Halo (GMKTEC EVO-X2) with 128GB unified memory. Setup is llama.cpp (ROCm 7 RC, rocWMMA) with Q4_K_M GGUF, 8K context, all 99 layers offloaded to GPU, 2 parallel slots. Short prompt (9 tokens) prefill was 4.94 t/s; medium (51 tokens) 28.29 t/s and 71.00 t/s generation; large (88 tokens) 46.81 t/s and 68.09 t/s generation. User rates the setup 5/5 and notes generation is 62% faster than a previous Llama-2-7B baseline.