Qwen3.6 35B (3B active)
on AMD RX 9060 XT 16GB · PolyStrata-HIP · 31,296 ctx
Summary
User reports Qwen3.6-35B-A3B at 70.7 tok/s generation on a 31,296-token prompt on an RX 9060 XT 16GB with a Ryzen 5 5600X and 32GB RAM on Windows 11.
Setup is the PolyStrata-HIP fork of the strata-poly GGUF engine with Unsloth's UD-Q3_K_M quant, FP16 KV cache and MTP speculation enabled; experts not resident in VRAM are computed on the CPU from system RAM.
Prefill on that run was 1,326 tok/s. Shorter warm prompts reached 93.4 tok/s at 2,068 tokens and 85.8 tok/s at 8,235 tokens, while a 45,355-token prompt gave 61.9 tok/s. With Q8_0 KV and 262,144 tokens of allocated capacity, a 400-token response ran at 33.8 tok/s capped at 2,000 resident experts versus 47.6 tok/s uncapped with 5,097 resident. Streaming KV through pinned RAM at roughly 261K tokens dropped generation to 3.64 tok/s.