Qwen3.6 35B (3B active)

User reports Qwen3.6-35B-A3B at 101.7 tok/s on short prompts on an RTX 3090 24GB. Setup is llama.cpp with Q4_K_XL, q8_0 KV cache, 65536 context, flash attention on, and all layers offloaded to the GPU. The same model on Ollama reached 98.9 tok/s at 32k context and 23.4 GB VRAM. Qwen3.5-35B-A3B on llama.cpp reached 142.2 tok/s at 65k context and 21.7 GB VRAM. The author corrected an earlier comparison: llama.cpp was 1.4x faster than Ollama, not 2.4x, because Ollama had overflowed to the CPU in the first test. No speculative decoding; only generation speed was measured.