Qwen3.8 27B
on NVIDIA RTX 5070 Ti · llama.cpp · 65,536 ctx
Sep 7, 2026
Summary
User reports Qwen3.8-27B at ~18-20 t/s generation speed on 16 GB VRAM and 64 GB system RAM.
Setup uses FFN offloading to keep attention on the GPU, a q8_0 KV cache at 65k context, MTP speculative decoding, and thread pinning.