Qwen3.8 27B
on NVIDIA RTX 5070 Ti · llama.cpp · 32,768 ctx
Sep 7, 2026
Summary
User reports Qwen3.8-27B at Q3_K_XL on an RTX 5070 Ti 16GB with llama.cpp, reaching about 73 t/s at 32k context with MTP on and fully GPU-resident.
At-depth generation is 64.5 t/s at 24.1k depth, with prefill at 1647 t/s at depth. MTP off gives about 50 t/s.
The practical context ceiling is 40k, or 49k with MTP off. The user also compares Q3_K_XL against Q2_K_XL and finds Q3 faster than its size predicts.