llamaperf

Qwen3.8 27B

on NVIDIA RTX Pro 6000 Blackwell · vLLM · 262,144 ctx

Tone: mixedNVIDIA hardware
Sep 7, 2026
Throughput
114.8 t/s gen
Quant
FP8
KV cache
fp8
VRAM reported
96 GB

Summary

User compares Qwen3.8-27B-FP8 against Qwen3.6-27B-FP8 on an RTX PRO 6000 Blackwell with vLLM. In an MTP sweep, Qwen3.8 peaks at MTP 6 with 114.8 tok/s and Qwen3.6 peaks at MTP 7 with 131.6 tok/s. Qwen3.8 is 5-20% slower across MTP steps, though quality is comparable or better at some steps. A pre-sweep manual run at MTP 5 showed Qwen3.8 faster, at 108.9 vs 103.6 tok/s.