llamaperf

Qwen3.6 27B

on NVIDIA RTX Pro 6000 Blackwell · llama.cpp · 3,000 ctx

NVIDIA hardware
Sep 28, 2026
Throughput
118.0 t/s gen
Quant
Q8_0 (GGUF)
System RAM
92 GB
VRAM reported
96 GB

Summary

User benchmarks Qwen3.6 27B with MTP speculative decoding at 117.95 tok/s on an RTX Pro 6000 Blackwell, compared to 43.22 tok/s without MTP, a 2.73x speedup. Setup is llama.cpp with Q8_0 GGUF weights, 3000 token context, and 4 speculative tokens. Hardware is an RTX Pro 6000 Blackwell with 96GB VRAM and 92GB system RAM. A separate vLLM run of Gemma 4 31B FP8 with MTP averaged 124.26 tok/s over 10 runs, totaling 4740 tokens in 38.14s.