Qwen3-Next 80B (3B active)
Arc iGPU · Janas-LLM
- generation:
- 26.4 tokens/s
- prompt processing (prefill):
- 68.4 tokens/s
User reports Qwen3-Next-80B-A3B at 26.4 tok/s generation and 68.4 tok/s prompt processing on Janas-LLM, against 3.0 and 17.7 tok/s on llama.cpp. Setup is Janas-LLM streaming MoE experts from NVMe on a Core Ultra 9 185H laptop with 32 GB DDR5-5600 and an Arc iGPU; the 48.4 GB model is larger than the RAM. The same table gives Qwen3.6-35B-A3B at 28.0 tok/s reply and 136 tok/s prompt on Janas-LLM versus 12.1 and 81.8 on llama.cpp, and Qwen3-30B-A3B at 33.3 and 133 versus 15.0 and 122. The post announces Brebus, a Linux desktop app built on the engine.