Qwen3.6 35B (3B active)
on 4× Tesla M10 · colibri · 256 ctx
Summary
User reports Qwen3.6-35B-A3B at 2.45 tok/s on 4x Tesla M10 (Maxwell sm_50, 8 GB each, 32 GB combined).
Setup is colibri with int4 gs=64 and 256-token context; all 10,240 experts held in VRAM (100% hit, zero CPU misses), while the dense DeltaNet/attention trunk runs on a Sandy Bridge CPU with no AVX2/FMA.
The bottleneck is the CPU-side dense trunk, not the GPUs: a second CPU raises decode from 2.01 to 2.45 tok/s, and llama.cpp reaches 7.3 tok/s on the same hardware by offloading the trunk. A 1x GPU warm run gives 1.81 tok/s and a CPU-only run 0.09 tok/s.