Qwen3-Coder 30B (3B active)
on AMD Strix Halo 128GB · llama.cpp · 8,192 ctx
Use cases
coding
Summary
User reports Qwen3-Coder-30B-A3B-Instruct at 70.25 t/s generation on an AMD Strix Halo (GMKTEC EVO-X2) with 128GB unified memory.
Setup is llama.cpp (ROCm 7 RC, rocWMMA) with Q4_K_M GGUF, 8K context, all 99 layers offloaded to GPU, 2 parallel slots.
Short prompt (9 tokens) prefill was 4.94 t/s; medium (51 tokens) 28.29 t/s and 71.00 t/s generation; large (88 tokens) 46.81 t/s and 68.09 t/s generation. User rates the setup 5/5 and notes generation is 62% faster than a previous Llama-2-7B baseline.