llamaperf

Qwen3.8 27B

on Unknown GPU · llama.cpp · 180,000 ctx

Tone: mixed
Sep 11, 2026

Use cases

long-contextagentic

Summary

User reports Spomin, a router for live KV cache compaction using a llama.cpp fork, tested exclusively with Qwen 3.8 27B as the main LLM. Worker models are a fine-tuned Qwen2.5 3B and a Qwen3.5 9B with larger context, with DFlash2 for speculative decoding. On a research benchmark the score improved from 31 to 37/100 with the larger worker versus 57 unmanaged, with 75.2% less primary input and 60.7% less active time. On Tetris the run scored 16/16 plus 11/12 checks in 69.8 min versus 16/16 plus 12/12 in 149.6 min, with 22.6% fewer tokens. A 10:1 compression example goes from 400k source tokens to 40k summary tokens and 180k resident tokens. No GPU is specified and no t/s figures are given.