Qwen3-Coder-Next 80B (3B active)
on Unknown GPU · Ollama
Use cases
coding
Summary
User reports Qwen3-Coder-Next (80B MoE, 3B active) at 7.74 tok/s generation on an AMD Ryzen AI 9 HX PRO 370 with 96GB DDR5-5600, CPU-only.
Setup is Ollama 0.15.6 (llama.cpp build 7973) with Q4_K_M GGUF weights; 12 physical threads was optimal, SMT hurt, and CPU governor made no difference.
User compares against qwen2.5-coder:32b Q4_K_M at 3.54 tok/s on the same hardware and argues the MoE should reach 20-30+ tok/s by bandwidth math; cross-references an EPYC 9454P report where Qwen3-Next-80B hit 11.76 tok/s versus 63.10 for Qwen3-MoE-30B, and notes ik_llama.cpp reports ~1.9x faster MoE inference.