Qwen3.8 27B abliterated
on NVIDIA RTX 5070 Ti · llama.cpp · 131,072 ctx
Sep 28, 2026
Use cases
codinglong-contextagentic
Summary
User reports Qwen3.8 27B abliterated at 104.7 tok/s decode and 2,030 tok/s prefill on a 15,694-token prompt on an RTX 5070 Ti.
Setup is a patched llama.cpp build with IQ3_S GGUF, Q4_0 KV cache, 131,072-token context, and embedded MTP speculative decoding with up to 3 draft tokens.
At 128K a 128,794-token prompt prefilled at 1,576 tok/s and decoded at 91.3 tok/s; short-context decode reached 130.0-131.6 tok/s. The patch is not upstream and was written only for this model on this GPU.