llamaperf

Qwen3.8 27B Swift

on NVIDIA RTX 3090 · LlamAmpere · 200,000 ctx

Tone: positiveNVIDIA hardware
Sep 18, 2026
Quant
IQ4_XS (GGUF)
KV cache
8/TQ3
MTP (Multi-Token Prediction)
on
VRAM reported
24 GB

Use cases

coding

Summary

User reports Qwen3.8 27B Swift IQ4_XS on an RTX 3090 at 200k context, with 8/TQ3 KV cache. Setup is LlamAmpere v0.3.1 with custom kernels for EXL and ternary quants plus MTP heads. The release adds support for Turboderp's EXL format and Bonsai ternary 1.75/2bpw quants. MTP gave about 20% speed up on 1.75bpw and 50%+ on 2bpw in initial 3090 testing. User also tested Qwen Swift on Livecode with xhigh reasoning, performing within 1.5% of original Qwen BF16.