llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 3090 · Ollama · 65,536 ctx

Tone: mixedNVIDIA hardware
Sep 28, 2026
Throughput
112.4 t/s gen
VRAM reported
24 GB

Use cases

agentictool-use

Summary

User reports Qwen3.6 35B-A3B at 112.4 tok/s on an RTX 3090 24GB with 64K context. Setup is Ollama 0.32.14 with a Modelfile alias baking in num_ctx 65536; at 64K, 96.6% of layers were on GPU with about 0.71 GiB spilled to CPU. The same runner at 32K reached 139.6 tok/s, so 64K was about 20% slower. The user also compares agent task success rates: warning the model to fix wrong values gave 1/9 successful runs with 4 false completions, deterministic tool-layer correction gave 8/15 with 2 false completions, and the same tool-layer approach at 64K gave 5/6 with 0 false completions.