llamaperf

Qwen3-Coder-Next 80B (3B active)

on M4 Pro · llama.cpp · 40,000 ctx

Tone: negative
Sep 26, 2026
Throughput
24.0 t/s gen
Quant
Q4_K_M (GGUF)

Use cases

coding

Summary

User reports Qwen3-Coder-Next Q4_K_M generating roughly 24 t/s on an M4 Pro with llama.cpp build b7935, compared to roughly 60 t/s for the MLX 4bit version on the same machine. Setup is llama.cpp (llama-server) with Q4_K_M GGUF, 40000 token context, all layers on GPU, parallel 1, continuous batching. User notes the filled context was negligible as the models were freshly loaded, and that the same GGUF in LM Studio was also slow.