Qwen3.8 27B Swift-1.5
on 2× NVIDIA RTX 3080 20GB · vLLM · 8,192 ctx
Use cases
agenticcoding
Summary
User benchmarks Swift-1.5-Qwen3.8-27B-AWQ-INT4 on two RTX 3080 20GB cards with the new GPU performance unlock, reporting +20.8% prefill at 8K (967 to 1168 tok/s) and no decode change.
Setup is vLLM 0.32.0 with tensor parallel 2, FP8 KV cache, MTP enabled with 3 speculative tokens, 240W power limit per card.
Prefill gains grow with prompt length, up to +28.6% at 261,900 tokens (562 to 723 tok/s). Decode is reported as steps/s (about 16), which the user says works out to roughly 45 tok/s in real agentic coding with MTP acceptance around 2. Both GPUs thermally throttled to 1750MHz.