Qwen3.8 27B
on NVIDIA RTX 3090 · vLLM
Sep 7, 2026
Summary
User reports Qwen 3.8 27B at 100+ t/s generation at high context on 4x RTX 3090, each throttled to 200W.
Setup is vLLM with the flashinfer backend, INT8/W8A16, and MTP.
User adds that Gemma models also benefit, but vision models need --language-model-only.