Qwen3.8 27B
on NVIDIA RTX 5060 Ti 16GB · llama.cpp · 200,000 ctx
Sep 7, 2026
Summary
User reports over 200k context on 16 GB of VRAM with Qwen 3.8 27B at the IQ3_XXS quant.
Setup is a laptop with Thunderbolt 4 and an Aorus 5060 Ti AI Box eGPU on Windows 11, with the KV cache quantized to q5_1.
The user previously ran UD-Q3_K_XL at 140k context. Prompt processing dropped from 700-800 tk/s to 400 tk/s.