llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 3090 · llama.cpp · 262,144 ctx

Tone: positiveNVIDIA hardware
Sep 27, 2026
Throughput
120.0 t/s gen
Quant
Q3_K_M (GGUF)
KV cache
bf16
VRAM reported
24 GB

Use cases

codingtool-useagenticmathlong-context

Summary

User reports Qwen3.6-35B-A3B at 120 tok/s on an RTX 3090. Setup is llama.cpp with Unsloth's Q3_K_M GGUF quant and bf16 KV cache, using 23GB of the card's 24GB VRAM at 262144 tokens of context. The user says it is the first local model to saturate their personal task benchmark, running it for three days through OpenCode, though they note some tasks needed reinforced prompts and adapted tooling.