Qwen3.8 27B Swift-1.5-Uncensored
on NVIDIA RTX 3090 · llamAmpere · 131,072 ctx
Summary
User releases ATX-Swift-1.5-Qwen3.8-27B-Uncensored-MTP, a GGUF quantization suite for Qwen3.8 27B, and benchmarks it on a single RTX 3090 24GB.
Setup is llamAmpere with i1-Q5_K_M weights, turbo5/turbo4 KV cache, 131,072 context, and MTP speculative decoding with the draft head at Q8_0. The full model and KV cache fit in 23.4 GB of VRAM with -ngl 99.
At 80k-98k active tokens the custom quant sustains 50.05 to 53.72 t/s with burst peaks of 58.10 to 63.05 t/s, versus 44.94 to 45.79 t/s for the standard Q5 quant. Draft acceptance rises from 63.7-65.1% to 73.1-81.7%, with mean draft length 3.31 to 4.10 tokens per round.