llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 5060 8GB · LM Studio · 98,000 ctx

Tone: mixedNVIDIA hardware
Oct 18, 2026
Throughput
30.0 t/s gen
Quant
Q4_K_XL (GGUF)
KV cache
Q8_0
System RAM
32 GB
VRAM reported
8 GB

Use cases

codingagentic

Summary

User reports Qwen3.6 35B-A3B at close to 30 t/s on an RTX 5060 8GB with a Ryzen 5 3600 and 32GB RAM. Setup is LM Studio with Q4_K_XL weights and a Q8_0 KV cache, reaching 98k context by moving some layers out of VRAM; total VRAM use stays below 7.5GB and RAM around 28-30GB. The user is asking for a better agentic coding model for this hardware and doubts Qwen3.8 27B would fit, and has not yet tested the 2-bit Ternary Bonsai 2.