llamaperf

Qwen3.6 35B (3B active)

on 2× NVIDIA RTX 4090 · SGLang · 50,000 ctx

Tone: mixedNVIDIA hardware
Oct 21, 2026
Throughput
180.0 t/s gen · 9000-10000 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
AWQ 4-bit (AWQ)

Use cases

codingagentic

Summary

User reports Qwen3.6-35B-A3B at about 180 tok/s single-stream decode on two RTX 4090s at roughly 50k context, dropping to about 160 tok/s at roughly 110k. Setup is sglang with a QuantTrio AWQ 4-bit quant, TP=2 over PCIe with no NVLink. Prefill is 9-10k tok/s, and 8 concurrent requests reach 985 tok/s total. The user runs it as a GitLab code-review agent and says repetition is the main problem with local models, with the model looping on itself ending about 7% of runs (56 of 847).