llamaperf
Submit

NVIDIA RTX Pro 5000 Blackwell 72GB vs NVIDIA RTX PRO 6000 Max-Q for local LLMs

0 reports on the NVIDIA RTX Pro 5000 Blackwell 72GB and 12 on the NVIDIA RTX PRO 6000 Max-Q

Which is faster for local LLMs?

Nobody has reported the same model at the same quant on both cards yet, so there's no measured head-to-head. Memory bandwidth, which caps how fast a card can write, is 33% higher on the NVIDIA RTX PRO 6000 Max-Q (1,344 GB/s on the NVIDIA RTX Pro 5000 Blackwell 72GB, 1,792 on the NVIDIA RTX PRO 6000 Max-Q). The estimates below compare them on the models people run most.

NVIDIA RTX Pro 5000 Blackwell 72GB
Memory
72GB
Memory bandwidth
1,344 GB/s
FP16 compute
258 TFLOPS
Reports
0
NVIDIA RTX PRO 6000 Max-Q
Memory
96GB
Memory bandwidth
1,792 GB/s
FP16 compute
439 TFLOPS
Reports
12

Estimated by the calculator

The quant the calculator recommends for each card and its estimated speed at a 32,768-token context with 32 GB of system RAM, from memory bandwidth and the model's shape.

ModelNVIDIA RTX Pro 5000 Blackwell 72GBNVIDIA RTX PRO 6000 Max-Q
Qwen3.8 27B13.7 t/sFP1618.3 t/sFP16
Qwen3.8 125B · 6B active95.0 t/sQ3_K_M83.1 t/sQ5_K_S
DeepSeek V4 Flash 284B · 13B active9.2 t/sQ2_K, experts in RAM130.8 t/sQ2_K
Qwen3.6 35B · 3B active98.6 t/sQ8_057.5 t/sFP16
Qwen3.6 27B13.7 t/sFP1618.3 t/sFP16
Gemma 4 26B · 4B active32.7 t/sFP1649.3 t/sFP16

Change the context, RAM or model in the calculator: NVIDIA RTX Pro 5000 Blackwell 72GB · NVIDIA RTX PRO 6000 Max-Q

Every report on each card, with its source: NVIDIA RTX Pro 5000 Blackwell 72GB · NVIDIA RTX PRO 6000 Max-Q

More comparisons