llamaperf

Qwen3.6 27B

on NVIDIA RTX 5060 Ti 16GB · llama.cpp · 75,000 ctx

Tone: positiveNVIDIA hardware
May 6, 2026
Throughput
22.0 t/s gen · 760.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ4_XS (GGUF)
KV cache
Q8
Flash Attention
on
VRAM reported
16 GB

Summary

User reports Qwen3.6 27B IQ4_XS at 22 t/s generation and 760 t/s prompt processing on an RTX 5060 Ti 16GB. Setup is llama.cpp with TheTom's TurboQuant fork, a 75k context window, and a turbo4/turbo2 KV cache. The user also tested BF16, Q8_0, Q6_K, Q5_K_XL, Q4_K_XL, IQ4_XS, IQ3_XXS, Q3_K_XL, Q3_K_M and Q2_K_XL on an L40S or RTX 5060 Ti, comparing quality with a chess board SVG generation task, and recommends IQ4_XS as the minimum.