Qwen3-Coder-Next 80B (3B active)
on AMD Strix Halo 128GB · llama.cpp · 262,144 ctx
Use cases
codingagenticlong-context
Summary
User reports Qwen3-Coder-Next UD-Q6_K_XL at 36.75 t/s on tg32 on an AMD Strix Halo box, with prefill at 545.77 t/s on pp2048.
Setup is llama-server with -ngl 999, flash attention on, -c 262144, f16 KV cache and one slot, measured with llama-benchy 0.4.1 in API latency mode.
The tg32 rate is 36.75 ± 0.05 t/s with a peak of 37.94 ± 0.06 t/s. A 27B 8-bit XL model was too slow to be workable.