Qwen3.6 27B
on NVIDIA RTX 5060 Ti 16GB · llama.cpp · 131,072 ctx
Jun 6, 2026
Summary
User reports 19 t/s peak and 14 t/s during long generation at 65k context with the KV cache offloaded to RAM via -nkvo, which allows the whole model on GPU with an f16 KV cache.
Speed remained similar at 128k context with 63 layers on GPU.
Quantizing the KV cache to RAM did not improve performance.