llamaperf

Qwen3.8 27B Swift-1.5-Uncensored

on NVIDIA RTX 3090 · llamAmpere · 131,072 ctx

Tone: positiveNVIDIA hardware
Sep 30, 2026
Throughput
50.0-53.7 t/s gen
Quant
i1-Q5_K_M (GGUF)
KV cache
turbo5
VRAM reported
24 GB

Summary

User releases ATX-Swift-1.5-Qwen3.8-27B-Uncensored-MTP, a GGUF quantization suite for Qwen3.8 27B, and benchmarks it on a single RTX 3090 24GB. Setup is llamAmpere with i1-Q5_K_M weights, turbo5/turbo4 KV cache, 131,072 context, and MTP speculative decoding with the draft head at Q8_0. The full model and KV cache fit in 23.4 GB of VRAM with -ngl 99. At 80k-98k active tokens the custom quant sustains 50.05 to 53.72 t/s with burst peaks of 58.10 to 63.05 t/s, versus 44.94 to 45.79 t/s for the standard Q5 quant. Draft acceptance rises from 63.7-65.1% to 73.1-81.7%, with mean draft length 3.31 to 4.10 tokens per round.