Qwen3.8 27B Swift-1.5
on 2× NVIDIA RTX 3090 · vLLM · 128,000 ctx
Oct 11, 2026
Summary
User reports Qwen3.8 27B Swift 1.5 at almost 100 tok/s decode on 2x RTX 3090.
Setup is vLLM with an 8-bit AWQ + GPTQ W8A16 quant, 128k context and FP16 KV cache, MTP=5, around 21.6 GB used per card.
The quant was made on 4 RTX 3090; the user says it is less of an overthinker than the original Qwen3.8 27B.