Qwen3.8 27B
on 2× NVIDIA RTX 5070 Ti · llama.cpp · 96,000 ctx
Sep 7, 2026
Summary
User reports llama.cpp RPC across a 5070 Ti and a 1080 Ti over gigabit ethernet, running Qwen 3.8 27B at UD-Q4_K_XL with a Q8 KV cache and 96k context.
Best generation was 36 t/s with MTP enabled and GPU order RPC0,CUDA0. A prefill-focused config gave 560 pp and 19 tg.
UD-Q5_K_XL with a full KV cache gave 380 pp and 15 tg. User notes MTP tanks prefill speeds and uses VRAM, and that enabling KV quant for the draft model reduces context. User recommends jumbo frames and careful GPU ordering.