Qwen3.6 27B

on NVIDIA RTX 5090 · vLLM · 218,000 ctx

May 1, 2026

Throughput

80.0 t/s gen

Quant

NVFP4 (safetensors)

VRAM reported

32 GB

Summary

User reports Qwen3.6-27B at ~80 t/s on an RTX 5090 at 218k context. Setup is vLLM 0.19.1rc1 with NVFP4 quantization on a single card.