llamaperf

Qwen3.8 27B Swift-1.5

on 2× NVIDIA RTX 3090 · vLLM · 128,000 ctx

Tone: positiveNVIDIA hardware
Oct 11, 2026
Throughput
100.0 t/s gen
Quant
W8A16 (AWQ)
KV cache
FP16
VRAM reported
48 GB

Summary

User reports Qwen3.8 27B Swift 1.5 at almost 100 tok/s decode on 2x RTX 3090. Setup is vLLM with an 8-bit AWQ + GPTQ W8A16 quant, 128k context and FP16 KV cache, MTP=5, around 21.6 GB used per card. The quant was made on 4 RTX 3090; the user says it is less of an overthinker than the original Qwen3.8 27B.