llamaperf

Qwen3.8 27B

on NVIDIA RTX 3090 · vLLM

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
100.0 t/s gen
Quant
INT8
VRAM reported
24 GB

Summary

User reports Qwen 3.8 27B at 100+ t/s generation at high context on 4x RTX 3090, each throttled to 200W. Setup is vLLM with the flashinfer backend, INT8/W8A16, and MTP. User adds that Gemma models also benefit, but vision models need --language-model-only.