Qwen3.8 27B
on NVIDIA RTX 5060 Ti 16GB · beellama · 85,000 ctx
Use cases
visionlong-context
Summary
User reports Qwen3.8-27B running on an RTX 5060 Ti 16GB with vision and 85K context, leaving 1.5GB VRAM headroom.
Setup is beellama, a llama.cpp fork, with MTP speculative decoding, the IQ3_XXS-mtp quant from ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF, and a kvarn4 KV cache quant.
The user notes mmproj could be moved to CPU for more VRAM.