llamaperf

Qwen3.6 35B (3B active)

on 4× Tesla M10 · colibri · 256 ctx

Tone: mixed
Oct 6, 2026
Throughput
2.5 t/s gen
Quant
int4 gs=64
System RAM
128 GB
VRAM reported
8 GB

Summary

User reports Qwen3.6-35B-A3B at 2.45 tok/s on 4x Tesla M10 (Maxwell sm_50, 8 GB each, 32 GB combined). Setup is colibri with int4 gs=64 and 256-token context; all 10,240 experts held in VRAM (100% hit, zero CPU misses), while the dense DeltaNet/attention trunk runs on a Sandy Bridge CPU with no AVX2/FMA. The bottleneck is the CPU-side dense trunk, not the GPUs: a second CPU raises decode from 2.01 to 2.45 tok/s, and llama.cpp reaches 7.3 tok/s on the same hardware by offloading the trunk. A 1x GPU warm run gives 1.81 tok/s and a CPU-only run 0.09 tok/s.