Qwen3.8 27B
on NVIDIA RTX 5090 · llama.cpp · 137,984 ctx
Sep 7, 2026
Summary
User benchmarks context length against KV cache quants on an RTX 5090 with Qwen3.8 27B MTP Q8_0 GGUF.
Maximum stable context is 105,216 tokens with a Q8_0 KV cache, 137,984 with Q5_1, and 169,984 with Q4_0.
Throughput dropped from 100 t/s to 25 t/s, which the user attributes to a llama.cpp issue.