Qwen3.6 27B
on NVIDIA RTX Pro 6000 Blackwell · llama.cpp · 3,000 ctx
Sep 28, 2026
Summary
User benchmarks Qwen3.6 27B with MTP speculative decoding at 117.95 tok/s on an RTX Pro 6000 Blackwell, compared to 43.22 tok/s without MTP, a 2.73x speedup.
Setup is llama.cpp with Q8_0 GGUF weights, 3000 token context, and 4 speculative tokens. Hardware is an RTX Pro 6000 Blackwell with 96GB VRAM and 92GB system RAM.
A separate vLLM run of Gemma 4 31B FP8 with MTP averaged 124.26 tok/s over 10 runs, totaling 4740 tokens in 38.14s.