llamaperf

Qwen3.8 27B

on NVIDIA RTX 4080 Super · llama.cpp · 73,728 ctx

Tone: negativeNVIDIA hardware
Oct 4, 2026
Throughput
33.1 t/s gen
Quant
Q3_K_XL (GGUF)
KV cache
Q8_0
VRAM reported
16 GB

Use cases

long-context

Summary

User reports Qwen3.8-27B decode throughput collapsing from 33.1 t/s at 68K position to 1.4 t/s at 91K position on an RTX 4080 Super 16GB. Setup is llama.cpp (master 8144f31) with UD-Q3_K_XL GGUF and Q8_0 KV cache, no flash attention, 73728 context, single GPU with zero CPU tensor overrides. Prompt processing stays fast at ~1300 t/s at the same 91K position. The user notes the cliff is positional rather than a memory-spill issue, reproduced across q4_0/q5_0/q8_0 KV quants and with FA on/off, and also under Windows native b10488.