Qwen3.8 27B
on NVIDIA RTX Pro 6000 Blackwell · vLLM · 262,144 ctx
Sep 7, 2026
Summary
User reports Qwen3.8-27B at about 56 t/s decode and about 3K t/s prefill on a single RTX PRO 6000 96GB GPU.
Setup is vLLM with an 8-bit quant at about 262K context, serving three concurrent users.
The figures are for three concurrent users, and the user offers free community access rather than presenting a benchmark.