Qwen3.8 27B

User reports Qwen3.8 27B running a local agent loop for about 21 days on a single RTX 3090, with prefill around 250 t/s. Setup is vLLM serving the Q4 model with a Q8 KV cache at 200k context, using a deepseek harness and a written rulebook; llama.cpp reaches about 700 prefill t/s on the same card. The run used 180 subagents, about 230M tokens in and out, 1.7B cache-read tokens, and 699 compactions totaling about 83 hours, roughly 17% of calendar time, with a typical compact taking about 7 minutes on a 160k+ token prompt.