Qwen3.8 27B
on NVIDIA RTX 3090 · vLLM · 150,000 ctx
Sep 27, 2026
Summary
User reports Qwen3.8-27B at 127 tok/s single-stream on a single RTX 3090 at 250 W.
Setup is vLLM with a 150k token context and an OpenAI-compatible API, in single-user mode.
Aggregate decode is ~1,035 tok/s at 64 concurrent in batch mode, and 381 tok/s when the answer quotes its own prompt.