llamaperf
Oct 18, 2026
Throughput
23.0 t/s gen
KV cache
Q4_0
System RAM
32 GB
VRAM reported
8 GB

Summary

User reports Qwen3.6 35B-A3B generating 23 t/s at its maximum context window on an RTX 4060 8GB with 32GB of system RAM. The engine is not named; the KV cache is quantized to Q4_0. The user notes the first token took a long time to generate. The 35B model does not fit in 8GB of VRAM, so weights ran partly from system memory.