Qwen3.8 27B
on Unknown GPU · llama.cpp · 180,000 ctx
Use cases
long-contextagentic
Summary
User reports Spomin, a router for live KV cache compaction using a llama.cpp fork, tested exclusively with Qwen 3.8 27B as the main LLM.
Worker models are a fine-tuned Qwen2.5 3B and a Qwen3.5 9B with larger context, with DFlash2 for speculative decoding.
On a research benchmark the score improved from 31 to 37/100 with the larger worker versus 57 unmanaged, with 75.2% less primary input and 60.7% less active time. On Tetris the run scored 16/16 plus 11/12 checks in 69.8 min versus 16/16 plus 12/12 in 149.6 min, with 22.6% fewer tokens. A 10:1 compression example goes from 400k source tokens to 40k summary tokens and 180k resident tokens. No GPU is specified and no t/s figures are given.