Qwen3.6 35B (3B active)

User reports Qwen3.6-35B-A3B at 3-5 t/s on a Radeon RX 6600 8GB with 64 GB DDR4 2800 and PCIe 3.0. The model was run with Q5_K_M quantization and required CPU offloading, which the user notes is as slow as running entirely on CPU due to slow PCIe and RAM. Setup is llama.cpp with GGUF Q5_K_M, offloading to CPU. The user also tested qwen2.5-coder-7b-instruct-q5_k_m (good speed but limited context up to 24k) and DeepSeek-R1-Distill-Qwen-7B-Q4_K_M for general chat. User asks whether 8GB VRAM is sufficient for complex tasks and what others use their local AI for. Sentiment is mixed: some models work but are too slow or limited for real-world use.