Qwen3.8 27B
on NVIDIA RTX 5070 Ti Laptop 12GB · llama.cpp · 262,144 ctx
Summary
User reports Qwen 3.8 27B UD Q4_K_XL on an RTX 5070 Ti Mobile 12GB with llama.cpp, at roughly 1.5-5 t/s in a context-prioritized configuration and roughly 9-11.5 t/s in a speed-prioritized one.
Setup uses a q8_0 KV cache, with context at 262144 in the first configuration and 98304 in the second.
User praises the model's capability and instruction following.