llamaperf

Qwen3.8 27B

on NVIDIA RTX 5080 · llama.cpp · 49,152 ctx

Tone: mixedNVIDIA hardware
Sep 13, 2026
Throughput
12.0 t/s gen
Quant
NVFP4 (GGUF)
KV cache
q4_0
Flash Attention
on
VRAM reported
16 GB

Summary

User reports Qwen3.8 27B at around 12 t/s on an RTX 5080 16GB at 49,152 context. Setup is llama.cpp with an NVFP4 GGUF, q4_0 K cache and iq4_nl V cache, flash attention on, 512 batch and ubatch, 16 threads. User is asking for pi.dev plugin suggestions for context, compaction and memory management, and is disappointed that compaction settings are kept separate from model settings.