llamaperf

Qwen3-Coder reports

27 reports. These are individual setups, not a controlled benchmark. Qwen3-Coder speeds by hardware →

Speeds are as each source reported them. GPU count, offloading and concurrent requests change them, and prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing two reports.

Qwen3-Coder 30B (3B active)

AMD Radeon 8060S integrated GPU (Strix Halo, gfx1151) · 1bit engine / llama.cpp (Vulkan 7fe450e)

generation:
84.7 tokens/s
prompt processing (prefill):
1297.0 tokens/s
quant:
UD-Q4_K_XL (GGUF)

User reports Qwen3-Coder 30B-A3B at 84.7 t/s generation and 1297 t/s prompt processing on one Strix Halo integrated GPU. Setup is llama.cpp Vulkan pin 7fe450e with Unsloth Dynamic UD-Q4_K_XL GGUF, 124 GB unified memory visible to the backend. The figures are separate synthetic llama-bench pp512 and tg128 phases, not client TTFT or end-to-end throughput; total context capacity is unspecified.

Oct 13, 2026
AMD hardware
generation:
196.0 tokens/s
quant:
BF16 (safetensors)
coding

User benchmarks Qwen3-Coder-30B-A3B-Instruct in BF16 and FP8 on a single MI300X 192GB, reporting 196 tok/s at 1 concurrent request for BF16 and 136 tok/s for FP8. Setup is vLLM 0.29.1 in the rocm/vllm container on AMD Developer Cloud, 1024 prompt tokens and 256 output tokens, vllm bench serve. The 1-request figures are medians of 3 warm runs. FP8 is 31% slower at 1 request but 35% faster at 64 concurrent (3442 vs 2555 tok/s). Accuracy on GSM8K (250 problems) was 96.4% BF16 vs 94.0% FP8. llama.cpp with Q4_K_M reached 187 tok/s at 1 user. Also ran gpt-oss-120b (72 tok/s at 1, 1423 at 64) and Qwen2.5-72B BF16 (26 tok/s at 1, 421 at 32). Total cost about $5.73.

Oct 12, 2026
NVIDIA hardware
generation:
51.7 tokens/s
prompt processing (prefill):
1928.1 tokens/s
quant:
Q4_K_M (GGUF)

User reports Qwen3-Coder 30B-A3B at 51.7 t/s generation and 1928.1 t/s prompt processing on an NVIDIA RTX 5080. Setup is Ollama with Q4_K_M at a configured 16384-token context, with partial CPU/RAM offload since the model exceeds VRAM. The recorded prompt was 1347 tokens, not a full 16384-token prefill, and the figures are medians of 3 fresh-prefill runs; 74% GPU residency was measured separately at 8K context, not this cell.

Oct 12, 2026
Apple hardware
generation:
64.4 tokens/s
prompt processing (prefill):
645.0 tokens/s
quant:
Q4_K_M (GGUF)

User reports Qwen3-Coder 30B-A3B at 64.4 t/s generation and 645 t/s prompt processing on an M1 Max 64GB. Setup is llama.cpp with Q4_K_M, measured via llama-bench on Metal. The figure is a native prefill/decode rate, not a TTFT-derived estimate; exact test lengths, context, batch settings and KV precision are not given.

Oct 12, 2026
AMD hardware
generation:
62.8 tokens/s
prompt processing (prefill):
1692.0 tokens/s
quant:
Q8_0
mtp (multi-token prediction):
off

User reports Qwen3-Coder 30B-A3B at 62.8 t/s generation and 1692 t/s prompt processing on an AMD Gorgon Halo 192GB machine. Setup is llama.cpp with Q8_0 and the Vulkan backend, all layers on GPU, on a Minisforum MS-S1 MAX-P495 with Ryzen AI Max+ PRO 495 and 192 GB unified memory. The 1692 t/s and 62.8 t/s come from separate llama-bench pp512 and tg128 tests, not a paired 512-input/128-output run; the same source reports about 205 t/s prompt and 33.1 t/s generation at roughly 32k depth.

Oct 11, 2026
Tone: positiveAMD hardware
generation:
70.3 tokens/s
quant:
Q4_K_M (GGUF)
rating:
5/5
coding

User reports Qwen3-Coder-30B-A3B-Instruct at 70.25 t/s generation on an AMD Strix Halo (GMKTEC EVO-X2) with 128GB unified memory. Setup is llama.cpp (ROCm 7 RC, rocWMMA) with Q4_K_M GGUF, 8K context, all 99 layers offloaded to GPU, 2 parallel slots. Short prompt (9 tokens) prefill was 4.94 t/s; medium (51 tokens) 28.29 t/s and 71.00 t/s generation; large (88 tokens) 46.81 t/s and 68.09 t/s generation. User rates the setup 5/5 and notes generation is 62% faster than a previous Llama-2-7B baseline.

Oct 9, 2026
AMD hardware
generation:
66.1 tokens/s
quant:
Q4_K_M (GGUF)
coding

User benchmarks Qwen3 Coder 30B A3B at 66.11 t/s generation on one AMD Radeon Instinct Mi50 32GB. Setup is llama.cpp build 128d522c (6686) with the ROCm backend, Q4_K_M quant (17.28 GiB), -ngl 99, 112 threads and --numa distribute on a dual Xeon 8480+ host. Other quants on the same card: Q5_0 65.15 t/s, Q6_K 62.49 t/s, Q8_0 64.20 t/s. BF16 (56.89 GiB) required two GPUs and ran 41.41 t/s. With 16K tokens of output the rate falls to about 20 t/s.

Sep 30, 2026