Qwen3-Coder 30B (3B active)
on GTX 1060 6GB · llama.cpp · 131,072 ctx
Use cases
codingagentictool-use
Summary
User reports Qwen3-Coder-30B-A3B at 25 t/s prompt processing and 4.5 t/s generation on a GTX 1060 6GB, with an 11K-token initial context including MCP tools.
Setup is llama.cpp (llama serve) with Q4_K_M weights, q8_0 KV cache, 131072 context, -cmoe CPU offload and 10 threads on a Xeon E5-2666 v3 with 16GB RAM; the run uses 4.5GB VRAM and up to 13GB system RAM.
User finds the model struggles with short prompts and asks for alternatives good at agentic coding and tool calling.