llamaperf

Qwen3.6 27B

on NVIDIA RTX Pro 6000 Blackwell · Paddock

Tone: positiveNVIDIA hardware
Sep 7, 2026
Quant
Q8
VRAM reported
96 GB

Summary

User benchmarks Qwen3.6-27B at 32 concurrent clients on the Paddock engine, with TTFT of 697 ms against 2.5 s for vLLM and 6.9 s for llama.cpp. User also reports Qwen3.8-27B at Q8 on an RTX PRO 6000 with speculation on and off: 46.8 to 202 tok/s single stream, 320 to 822 at eight concurrent chats, and 1005 to 1285 at 32. The engine is free but not open source.