Qwen3-Coder 30B (3B active)
on AMD Ryzen AI Max+ 395 / Radeon 8060S (Framework Desktop; 64 GB unified) · llama.cpp
Summary
User reports Qwen3-Coder-30B-A3B-Instruct at 69.2 t/s generation and 1242.4 t/s prompt processing on a Framework Desktop with AMD Ryzen AI Max+ 395 and Radeon 8060S, 64 GB unified memory.
Setup is llama.cpp with UD-Q6_K_XL, f16 K/V cache, flash attention, one Vulkan device and 99 GPU layers.
The two figures are separate depth-0 arms, PP512 and TG32, not one 512-input/32-output run.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Qwen3-Coder 30B · 3B active at 4-bit by hardware
- 107.0 t/s · one run
- 70.3 t/s · 2 runs
- 69.9 t/s · 6 runs
- 66.1 t/s · one run
Bars are medians on one scale, 0 to 107.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.