Qwen3.8 27B
on 2× NVIDIA RTX 5070 Ti · llama.cpp · 32,768 ctx
Sep 28, 2026
Use cases
coding
Summary
User reports Qwen3.8-27B at 140.5 tok/s median on 2x RTX 5070 Ti 16GB, up from 69.7 tok/s without speculation.
Setup is llama.cpp b10990 with UD-Q4_K_XL GGUF, 32768 context, F16 KV cache, tensor split 1:1, and ungated MTP n-max 6.
Combined generation rate across three workloads is 126.74 tok/s (1.82x), aggregate acceptance 0.440, peak GPU memory 20.20 GiB, mean power 482 W. The four-request MTP result is 231.0 aggregate tok/s.