Qwen3.6 27B
on NVIDIA RTX 5060 Ti 16GB · llama.cpp · 75,000 ctx
May 6, 2026
Summary
User reports Qwen3.6 27B IQ4_XS at 22 t/s generation and 760 t/s prompt processing on an RTX 5060 Ti 16GB.
Setup is llama.cpp with TheTom's TurboQuant fork, a 75k context window, and a turbo4/turbo2 KV cache.
The user also tested BF16, Q8_0, Q6_K, Q5_K_XL, Q4_K_XL, IQ4_XS, IQ3_XXS, Q3_K_XL, Q3_K_M and Q2_K_XL on an L40S or RTX 5060 Ti, comparing quality with a chess board SVG generation task, and recommends IQ4_XS as the minimum.