Qwen3.6 35B (3B active)
on Unknown GPU · llama.cpp
Use cases
coding
Summary
User reports Qwen3.6-35B-A3B Q4_K_M decoding at 25-30 tok/s on a 16 GB Mac with the adaptive streaming planner enabled, up from 7 tok/s without it.
Setup is llama.cpp with a streaming MoE planner; a 2000-token prompt drops from 21 s on CPU to 3.4 s on GPU.
The same 21 GB model runs on a 12 GB Android phone at 10 tok/s decode and 100-300+ tok/s prefill on the NPU, and on a 16 GB Windows laptop at 5 tok/s. Qwen3.8-Flash-Next 125B reaches 6.5-9 tok/s on the 16 GB Mac and 2.2-3.5 tok/s on the phone; DeepSeek V4 Flash 284B runs at 1 tok/s on the phone.