llamaperf

Qwen3.8 27B Swift-1.5

on 2× NVIDIA RTX 3080 20GB · vLLM · 8,192 ctx

Tone: positiveNVIDIA hardware
Oct 24, 2026
Throughput
1168.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
AWQ-INT4 (AWQ)
KV cache
FP8
VRAM reported
20 GB

Use cases

agenticcoding

Summary

User benchmarks Swift-1.5-Qwen3.8-27B-AWQ-INT4 on two RTX 3080 20GB cards with the new GPU performance unlock, reporting +20.8% prefill at 8K (967 to 1168 tok/s) and no decode change. Setup is vLLM 0.32.0 with tensor parallel 2, FP8 KV cache, MTP enabled with 3 speculative tokens, 240W power limit per card. Prefill gains grow with prompt length, up to +28.6% at 261,900 tokens (562 to 723 tok/s). Decode is reported as steps/s (about 16), which the user says works out to roughly 45 tok/s in real agentic coding with MTP acceptance around 2. Both GPUs thermally throttled to 1750MHz.