llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 5070 Ti · llama.cpp · 32,768 ctx

NVIDIA hardware
Sep 28, 2026
Throughput
140.5 t/s gen
Quant
UD-Q4_K_XL (GGUF)
KV cache
F16
VRAM reported
16 GB

Use cases

coding

Summary

User reports Qwen3.8-27B at 140.5 tok/s median on 2x RTX 5070 Ti 16GB, up from 69.7 tok/s without speculation. Setup is llama.cpp b10990 with UD-Q4_K_XL GGUF, 32768 context, F16 KV cache, tensor split 1:1, and ungated MTP n-max 6. Combined generation rate across three workloads is 126.74 tok/s (1.82x), aggregate acceptance 0.440, peak GPU memory 20.20 GiB, mean power 482 W. The four-request MTP result is 231.0 aggregate tok/s.