Qwen3.6 27B
on RTX 5000 PRO 48GB · vLLM · 196,608 ctx
Use cases
codingagentic
Summary
User reports 60-90 t/s with a typical 80 t/s on vLLM 0.20.1 with CUDA 12.9.
Setup uses a BF16 KV cache and MTP=2 speculative decoding.
on RTX 5000 PRO 48GB · vLLM · 196,608 ctx