Qwen3.8 27B Swift
on NVIDIA RTX 3090 · LlamAmpere · 200,000 ctx
Use cases
coding
Summary
User reports Qwen3.8 27B Swift IQ4_XS on an RTX 3090 at 200k context, with 8/TQ3 KV cache.
Setup is LlamAmpere v0.3.1 with custom kernels for EXL and ternary quants plus MTP heads. The release adds support for Turboderp's EXL format and Bonsai ternary 1.75/2bpw quants.
MTP gave about 20% speed up on 1.75bpw and 50%+ on 2bpw in initial 3090 testing. User also tested Qwen Swift on Livecode with xhigh reasoning, performing within 1.5% of original Qwen BF16.