llama.cpp on the NVIDIA RTX Pro 5000 Blackwell 72GB
llamaperf has 4 llama.cpp reports on the NVIDIA RTX Pro 5000 Blackwell 72GB, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.
4 llama.cpp reports on the NVIDIA RTX Pro 5000 Blackwell 72GB
Newest first. A run on several cards, with speculative decoding, with part of the model in system RAM or with batched requests says so, since each describes a different setup.
- Qwen3.6 35B · 3B active · Q8_0198.0 t/s
- Gemma 4 31B · Q8_033.2 t/s
- Muse 28B · Q8_038.5 t/s
- Qwen3.8 27B · Q8_038.6 t/s
Frequently asked
How fast is llama.cpp on the NVIDIA RTX Pro 5000 Blackwell 72GB?
llamaperf has 4 llama.cpp reports on the NVIDIA RTX Pro 5000 Blackwell 72GB, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.