SGLang on the NVIDIA RTX Pro 6000 Blackwell
llamaperf has 9 SGLang reports on the NVIDIA RTX Pro 6000 Blackwell, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.
9 SGLang reports on the NVIDIA RTX Pro 6000 Blackwell
Newest first. A run on several cards, with speculative decoding, with part of the model in system RAM or with batched requests says so, since each describes a different setup.
- GLM-5.3 320B · 18B active · W4A16-NVFP4-K32-Experts-FP8-WO164.8 t/s(2 cards, speculative decoding)
- Minimax M3 428B · 23B active · NVFP488.5 t/s(4 cards)
- GLM-4.5-Air 106B · 12B active · FP8133.0 t/s(4 cards)
- DeepSeek V4.1 Flash 552B · 16B active · FP4200.9 t/s(4 cards, speculative decoding, part in system RAM)
- Qwen3.8 27B · NVFP4210.0 t/s(speculative decoding)
- GLM-5.3 320B · 18B active · NVFP463.7 t/s(4 cards)
- Qwen3.8 27B · BF1677.6 t/s(speculative decoding)
- Qwen3.8 125B · 6B active · NVFP4PP 11352.0 t/s
- Qwen3.8 27B · FP8150.0 t/s(2 cards, speculative decoding)
Frequently asked
How fast is SGLang on the NVIDIA RTX Pro 6000 Blackwell?
llamaperf has 9 SGLang reports on the NVIDIA RTX Pro 6000 Blackwell, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.