Qwen3.8 27B
on NVIDIA RTX 3090 · vLLM · 195,000 ctx
Sep 7, 2026
Summary
User reports Qwen3.8 27B at 82 t/s single request on an RTX 3090, with up to 672 t/s peak and 417 t/s sustained at 64 concurrent.
Setup is vLLM with W4A16 quantization, an FP8 KV cache, and int8 lm_head and embed_tokens, at up to 195k context.
The title says Qwen3.8-27b while the body mentions Qwen3.6-28B.