Qwen3.6 27B
on 2× NVIDIA RTX 3060 12GB · llama.cpp · 64,000 ctx
May 27, 2026
Summary
User reports 43.26 t/s generation and 456 t/s prefill at 12k context on dual RTX 3060 cards.
Setup is tensor parallel with MTP enabled and 64k context.
Without MTP at 96k context, generation is 31 t/s. User praises the value and stability of CUDA.