llamaperf

Qwen3.6 27B

on NVIDIA RTX 3090 · BeeLlama · 128,000 ctx

NVIDIA hardware
May 20, 2026
Quant
Q5_K_S (GGUF)
KV cache
Q8
VRAM reported
24 GB

Use cases

long-context

Summary

User benchmarks KV cache quantization methods with Qwen3.6 27B at 64k and 128k context. The IQ4_XS quant is also tested.