llamaperf

Qwen3.6 27B

on NVIDIA RTX 5060 Ti 16GB · llama.cpp · 131,072 ctx

Tone: positiveNVIDIA hardware
Jun 6, 2026
Throughput
19.0 t/s gen
Quant
IQ4_XS (GGUF)
KV cache
F16
System RAM
32 GB
VRAM reported
16 GB

Summary

User reports 19 t/s peak and 14 t/s during long generation at 65k context with the KV cache offloaded to RAM via -nkvo, which allows the whole model on GPU with an f16 KV cache. Speed remained similar at 128k context with 63 layers on GPU. Quantizing the KV cache to RAM did not improve performance.