llamaperf

Qwen3.8 27B

on NVIDIA RTX PRO 6000 Max-Q · NInfer

Tone: positiveNVIDIA hardware
Oct 6, 2026
Throughput
130-180 t/s gen
Quant
NVFP4 (NVFP4)

Use cases

agenticcoding

Summary

User reports Qwen3.8 27B at 130-180 t/s on an RTX Pro 6000 Blackwell Max-Q. Setup is NInfer with NVFP4 weights, DFlash2 and MTP-7 speculative decoding, on Windows 10. The user says parallel decoding shows hardly any slowdown and concurrent capabilities are on par with vLLM, and notes the backend is new and still missing features such as advanced sampling parameters and broader model support.