Qwen3.8 27B Swift Uncensored
on NVIDIA RTX 3090 · llamAmpere · 262,144 ctx
Summary
User reports 95+ t/s generation for Qwen3.8 27B on a single RTX 3090, sustained through 100K generated tokens at 262K context.
Setup is the llamAmpere fork of llama.cpp (v0.4) with an IQ4_XS-M GGUF quant and TQ5/TQ4 KV cache, full GPU offload (-ngl 99), flash attention on, temp=1.
The figure is a minimum across the run; the user notes ~10% speed gain over the previous version and that the KV quant adds under a third of the KLD of the 8-bit to 4.6-bit weight quant.