llamaperf

Qwen3.8 27B Swift-1.5-Uncensored

on NVIDIA RTX 3090 Ti · llamAmpere · 262,144 ctx

NVIDIA hardware
Oct 4, 2026
Throughput
67.8 t/s gen
Quant
IQ4_XS (GGUF)
KV cache
turbo5
VRAM reported
24 GB

Use cases

codingagentic

Summary

User reports Qwen3.8-27B at 67.8 tok/s after a 250,000-token prompt on an RTX 3090 Ti. Setup is the llamAmpere v0.4 fork of llama.cpp with an IQ4_XS GGUF, turbo5/turbo4 KV cache, 262,144-token context, and the model's MTP drafter at depth 4. The run generated 5,120 tokens and peaked at 22,346 MiB of VRAM. The release tree decodes 104.28 tok/s on the v0.3.1 ship corpus and 103.09 tok/s at 100K KV depth.