Qwen3.6 35B (3B active)
on NVIDIA RTX 4070 · PolyStrata
Summary
User reports Qwen3.6-35B-A3B at 73-75 tok/s generation and 1,390 tok/s prompt processing on a laptop with an RTX 4070 8 GB, i7-14700HX and 32 GB RAM.
Setup is PolyStrata with UD-Q3_K_M GGUF, a 30,000-token prompt, CPU offload of experts and speculative decoding.
The same model on an RTX 5090 32 GB writes 332-334 tok/s and reads 5,520-5,580. Gemma 4 26B-A4B, Ornith 1.5 and GLM 5.3 Flash were also measured on both machines; GLM 5.3 Flash does not fit in 32 GB of RAM.