Qwen3.6 35B (3B active)

User reports Qwen3.6-35B-A3B at 37.96 ± 0.10 t/s generation and 1021.05 ± 1.24 t/s prompt processing on a 16 GB VRAM GPU. Setup is llama-server.exe with the Vulkan backend, the Unsloth IQ4_XS quant at ~4.25 bpw, --n-gpu-layers 99, --n-cpu-moe 16 to offload MoE experts to CPU, --threads 14, --batch-size 1024, --ubatch-size 1024, --flash-attn 1, q8_0 KV cache, --ctx-size 80000, --cache-ram 2048 and --no-mmap. The generation figure is tg1000 and the prompt processing figure is pp80000. The user runs it with a pi coding agent for file operations, tool calls, summarizations and MCP calls, and says it is usable on a 16 GB GPU.