llamaperf

Qwen3-Coder 30B (3B active)

on GTX 1060 6GB · llama.cpp · 131,072 ctx

Tone: mixed
Nov 11, 2026
Throughput
4.5 t/s gen · 25.0 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
Q4_K_M (GGUF)
KV cache
q8_0
System RAM
16 GB
VRAM reported
6 GB

Use cases

codingagentictool-use

Summary

User reports Qwen3-Coder-30B-A3B at 25 t/s prompt processing and 4.5 t/s generation on a GTX 1060 6GB, with an 11K-token initial context including MCP tools. Setup is llama.cpp (llama serve) with Q4_K_M weights, q8_0 KV cache, 131072 context, -cmoe CPU offload and 10 threads on a Xeon E5-2666 v3 with 16GB RAM; the run uses 4.5GB VRAM and up to 13GB system RAM. User finds the model struggles with short prompts and asks for alternatives good at agentic coding and tool calling.