Qwen3.6 27B
on 4× NVIDIA RTX 5060 Ti 16GB · 256,000 ctx
Use cases
coding
Summary
User reports 608 t/s cold prefill and 52.2 t/s decode on 4x RTX 5060 Ti 16GB at 256K context.
Setup is a Vast AI instance with the Q8 quant, an FP16 KV cache, and MTP enabled.
User considers this excellent for $2K hardware.