llamaperf

Qwen3-Coder-Next 80B (3B active)

on Unknown GPU · Ollama

Tone: negative
Oct 4, 2026
Throughput
7.7 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
96 GB

Use cases

coding

Summary

User reports Qwen3-Coder-Next (80B MoE, 3B active) at 7.74 tok/s generation on an AMD Ryzen AI 9 HX PRO 370 with 96GB DDR5-5600, CPU-only. Setup is Ollama 0.15.6 (llama.cpp build 7973) with Q4_K_M GGUF weights; 12 physical threads was optimal, SMT hurt, and CPU governor made no difference. User compares against qwen2.5-coder:32b Q4_K_M at 3.54 tok/s on the same hardware and argues the MoE should reach 20-30+ tok/s by bandwidth math; cross-references an EPYC 9454P report where Qwen3-Next-80B hit 11.76 tok/s versus 63.10 for Qwen3-MoE-30B, and notes ik_llama.cpp reports ~1.9x faster MoE inference.