Qwen3.6 35B (3B active)

User reports running Qwen3.6-35B-A3B UD-Q6_K_XL with a 256K context on an 8 GB NVIDIA GPU, keeping MoE experts in system RAM, at roughly 35-38 tok/s generation and 875-935 tok/s cold prefill. Setup is llama.cpp with Q8_0 K/V cache, CPU-MoE offload without mmap, on an Intel Core Ultra 7 265HX with 64 GB RAM; vanilla decoding, no speculative decoding. Longer cold-prefill testing stayed around 846 tok/s at roughly 58K processed tokens. MTP with Q4 and Q8 draft models was tested but varied with draft acceptance (one Q4 MTP-3 run reached only 52.8% acceptance and was slower than vanilla); DFlash was tested and gave only 15-17 tok/s. The setup is optimized for a single active inference slot.