Qwen3.6 35B (3B active)

User reports 27.01 t/s generation and 517.25 t/s prompt processing. Source evidence (verbatim): Source: https://note.com/ripe_hosta6920/n/nb81b72d54ad7?hl=en # First-hand RTX 3070 8GB Qwen3.6-35B-A3B CPU-MoE tuning benchmark Author try tested May 10, 2026; published May 13. Hardware: NVIDIA RTX 3070 8GB VRAM, Ryzen 7 3700X (8 CPU cores), 32GB DDR4 system RAM, native Windows. Runtime llama.cpp b9119-ef93e98d0, CUDA 13.1 build; installed CUDA 13.2. Model Qwen3.6-35B-A3B, Unsloth UD-IQ4_XS GGUF, approximately 17.7GB disk size, not resident RAM. Verified matching publisher repository: https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF ; tested revision unreported. Selected measured llama-bench row: generation 27.01 ±1.34 tokens/s (tg128); prefill 517.25 ±34.22 tokens/s (pp512). Separate synthetic PP512 and TG128 tests, not an end-to-end 512-input/128-output request. Settings: ncmoe 27, 9 threads, flash attention enabled, K/V cache q4_0; CPU MoE offloading is essential. Source shows server recipe ngl 999, no-mmap, context capacity 8192; 8192 is not measured prompt length. Repetition count, cache reuse, benchmark command details, speculative decoding and concurrency unreported. Resident RAM and exact VRAM usage unreported (author says nearly full). Other sweep rows and real-prompt Ollama comparison are distinct tests, not combined here. RTX3060 figures are quoted from another author and excluded. No Reddit material was accessed.