llamaperf

Qwen3.8 27B

on NVIDIA RTX Pro 6000 Blackwell · Paddock

Tone: positiveNVIDIA hardware
Sep 7, 2026
Quant
FP8
VRAM reported
96 GB

Summary

User benchmarks Qwen3.8-27B FP8 on one RTX PRO 6000 in Paddock, an open-source inference engine in Rust/C++ with its own CUDA kernels, reaching 1062 tok/s at 32 clients against 958 for vLLM and 844 for SGLang. Paddock is faster than vLLM in 13/13 cells, by 1.02x to 1.19x, and faster than llama.cpp Q8_0 in 13/13, by 1.5x to 37x.