Gemma 4 26B (4B active)
on GTX 1060 6GB · llama.cpp · 16,384 ctx
Summary
User reports Gemma 4 26B-A4B UD-Q4_K_XL at 15.8-16.4 tok/s generation and ~245 tok/s prefill without MTP on a GTX 1060 6GB with 16GB of single-channel DDR4.
Setup is a single GTX 1060 6GB, UD-Q4_K_XL weights, llama.cpp with 23 MoE layers' experts on the CPU (--n-cpu-moe 23), no speculative decoding, 16K context.
With the MTP Q8_0 drafter (--spec-draft-n-max 3) generation rises to 19-21.5 tok/s at 55-65% draft acceptance; a DFlash drafter managed only 13 tok/s at 25% acceptance.