Qwen3.6 27B
on 2× NVIDIA RTX 5070 Ti · llama.cpp · 128,000 ctx
May 1, 2026
Summary
User reports running Qwen3.6-27B Q4_K_M on an RTX 5070 Ti 16GB and an RTX 2060 6GB with llama-server, reaching pp 186.76 t/s and tg 19.21 t/s at 71k actual context.
Setup is llama-server with the Q4_K_M quant across the two cards.
llama-bench results with CUDA show tg speeds around 16-25 t/s depending on configuration.