Qwen3.6 35B (3B active) Uncensored-HauhauCS-Aggressive
on RTX 2060 6GB · llama.cpp · 131,072 ctx
Use cases
visionlong-context
Summary
User reports Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive at ~600 tok/s prefill and 23 tok/s decode on an RTX 2060 6GB with 32GB DDR4 RAM.
Setup is llama.cpp with Q4_K_M and Q8_0 KV cache at 131072 tokens of context, with 39 MoE expert layers on CPU and the vision projector on CPU to keep VRAM under ~5.2 GB.
At around 90k context the speeds settle to roughly 485 tok/s prefill and 15 tok/s decode.