Qwen3.8 27B Uncensored
on NVIDIA RTX 5090 · vLLM · 262,144 ctx
Sep 27, 2026
Use cases
long-contextvisiontool-useagentic
Summary
User reports Qwen3.8-27B Uncensored at 77.2 t/s decode after a 1K prompt and 64.7 t/s with 128K resident on a single RTX 5090.
Setup is vLLM 0.27.1 with an NVFP4 ModelOpt export, FP8 KV cache, prefix caching, vision and tool calling, at a 262,144-token context; the 19.18 GiB checkpoint leaves about 1.6 GiB free VRAM with KDE and Firefox running.
Prefill falls from 7,005 t/s at 8K to 1,578 t/s at 262K, and a 262,000-token prefill took 166 seconds. A shared 36,864-token prefix cut TTFT from 6.437 s to a 0.288 s median, a 22.3x speedup. The 128K and 262K rows are single runs.