Qwen3.6 35B (3B active)
on NVIDIA RTX 3090 · llama.cpp · 65,536 ctx
Summary
User reports Qwen3.6-35B-A3B Q6_K on an RTX 3090 in llama.cpp, with prompt processing improving from 564.5 to 1330.0 tok/s (2.36x) while TG stays at about 97.7 t/s.
Setup offloads 8 MoE expert layers to CPU with larger batch sizes, at 64K context and a Q8 KV cache, on a Threadripper PRO 3955WX with about 100 GB DDR4.
Measurements are two repetitions with about 1.6% drift.