Qwen3.8 27B
on NVIDIA RTX 5070 Ti · llama.cpp · 26,000 ctx
Sep 13, 2026
Summary
User reports Qwen3.8 27B at roughly 50 t/s on an RTX 5070 Ti 16GB with 32GB of DDR5 system RAM, at about 26,000 tokens of context.
Setup is llama.cpp with the unsloth UD-IQ4_XS GGUF, a q8_0 KV cache, flash attention on, and an MTP draft model (mtp-Qwen3.8-27B-Q4_0.gguf) for speculative decoding.
User is happy with the speed but feels the context window is too small and asks for ways to get a larger one.