llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 5070 · LM Studio · 65,536 ctx

Tone: mixedNVIDIA hardware
Sep 20, 2026
Throughput
35.0 t/s gen · 1000.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
KV cache
Q8
System RAM
32 GB
VRAM reported
12 GB

Use cases

coding

Summary

User reports Qwen3.6 35B-A3B at 35 t/s generation and 1000 t/s prompt processing on an RTX 5070 12GB with an i5-10400F and 32GB RAM. Setup is LM Studio with a 64k context, Q8 KV cache, flash attention, about 30 experts offloaded to CPU, and retain-thinking enabled. The run used about 10GB VRAM and 28GB system RAM at roughly 58K context. User asks whether more performance can be squeezed from the rig and reports inconsistent context reporting between Cline and OpenCode.