Qwen3.8 27B Swift-1.5-Uncensored
on NVIDIA RTX 3090 Ti · llamAmpere · 262,144 ctx
Use cases
codingagentic
Summary
User reports Qwen3.8-27B at 67.8 tok/s after a 250,000-token prompt on an RTX 3090 Ti.
Setup is the llamAmpere v0.4 fork of llama.cpp with an IQ4_XS GGUF, turbo5/turbo4 KV cache, 262,144-token context, and the model's MTP drafter at depth 4.
The run generated 5,120 tokens and peaked at 22,346 MiB of VRAM. The release tree decodes 104.28 tok/s on the v0.3.1 ship corpus and 103.09 tok/s at 100K KV depth.