Qwen3.8 27B
on NVIDIA RTX 5080 · llama.cpp · 49,152 ctx
Sep 13, 2026
Summary
User reports Qwen3.8 27B at around 12 t/s on an RTX 5080 16GB at 49,152 context.
Setup is llama.cpp with an NVFP4 GGUF, q4_0 K cache and iq4_nl V cache, flash attention on, 512 batch and ubatch, 16 threads.
User is asking for pi.dev plugin suggestions for context, compaction and memory management, and is disappointed that compaction settings are kept separate from model settings.