Qwen3.6 35B (3B active)
on RTX 4000 · ik_llama.cpp
Use cases
agentictool-use
Summary
User reports Qwen3.6 35B Q6 at 35-40 t/s decode on an RTX 4000 in a VM.
User is considering swapping to a Strix Halo (Bosgame M5) for more concurrent models or a larger MoE.
User also mentions Qwen3.8 27B on an RTX 3090 desktop and plans for larger models such as 3.5 122B or 3.8 Next Flash.