llamaperf

Qwen3.8 27B

on NVIDIA RTX 5070 Ti · llama.cpp · 26,000 ctx

Tone: mixedNVIDIA hardware
Sep 13, 2026
Throughput
50.0 t/s gen
Quant
UD-IQ4_XS (GGUF)
KV cache
q8_0
System RAM
32 GB
VRAM reported
16 GB

Summary

User reports Qwen3.8 27B at roughly 50 t/s on an RTX 5070 Ti 16GB with 32GB of DDR5 system RAM, at about 26,000 tokens of context. Setup is llama.cpp with the unsloth UD-IQ4_XS GGUF, a q8_0 KV cache, flash attention on, and an MTP draft model (mtp-Qwen3.8-27B-Q4_0.gguf) for speculative decoding. User is happy with the speed but feels the context window is too small and asks for ways to get a larger one.