llamaperf

Qwen3.8 27B Swift Uncensored

on NVIDIA RTX 3090 · llamAmpere · 262,144 ctx

Tone: positiveNVIDIA hardware
Oct 9, 2026
Throughput
95.0 t/s gen
Quant
IQ4_XS-M (GGUF)
KV cache
TQ5/TQ4

Summary

User reports 95+ t/s generation for Qwen3.8 27B on a single RTX 3090, sustained through 100K generated tokens at 262K context. Setup is the llamAmpere fork of llama.cpp (v0.4) with an IQ4_XS-M GGUF quant and TQ5/TQ4 KV cache, full GPU offload (-ngl 99), flash attention on, temp=1. The figure is a minimum across the run; the user notes ~10% speed gain over the previous version and that the KV quant adds under a third of the KLD of the 8-bit to 4.6-bit weight quant.