llamaperf

Qwen3.6 27B

on 2× NVIDIA H100 80GB · vLLM · 128,000 ctx

Tone: positiveNVIDIA hardware
May 1, 2026
Throughput
45.0 t/s gen
VRAM reported
160 GB

Use cases

codingagentic

Summary

User reports Qwen3.6-27B at 45 t/s on a rented GPU instance with 2x H100s and 160 GB of VRAM. Setup is vLLM at 128K context, serving multiple agents hitting the API at once, including Claude Code, QwenCode and social media bots. The instance costs about $0.90/hr, with $120 spent last month. The user says the model outperformed a 120B model in tests.