Qwen3.8 27B
on NVIDIA RTX 5060 Ti 16GB · llama.cpp · 65,536 ctx
Sep 7, 2026
Summary
User reports Qwen3.8-27B on an RTX 5060 Ti 16GB with llama.cpp, comparing the jpetrina IQ4_XS-pure and Unsloth UD-IQ4_XS quants.
Short-context generation runs at roughly 45-47 tok/s, dropping to about 31 tok/s after 55K prefill. The Unsloth quant has better fidelity (KLD 0.018 vs 0.0236), while jpetrina wins the multi-turn agent eval (40/80 vs 38/80).
Vision works but needs a separate profile. A Q8 baseline was used as a quality control.