Qwen3.6 35B (3B active)
on RTX 2060 Max-Q 6GB · llama.cpp · 65,536 ctx
Use cases
agentic
Summary
User reports Qwen3.6-35B-A3B, a 3B-active MoE, running on a 5-year-old laptop with an RTX 2060 Max-Q 6 GB and 24 GB RAM.
Setup is llama.cpp with a Q8 KV cache, flash attention, and 64k context.
A long context variant uses 128k context with Tom's fork.