Qwen3.8 27B
on NVIDIA A100 80GB · vLLM
Summary
User reports Qwen3.8-27B at ~18 tokens/s on an NVIDIA A100 80GB, compared with ~62 tokens/s for Qwen3.6-27B on the same hardware.
Setup is vLLM with unquantized (BF16/FP16) weights, same context length and prompt for both models.
User asks whether the 3.4x gap is expected and whether vLLM version, FlashAttention kernels, or Qwen3.8-specific configuration could explain it.