llamaperf

Qwen2.5 32B

on NVIDIA RTX 5090

NVIDIA hardware
Oct 19, 2026
Throughput
37.0 t/s gen
VRAM reported
32 GB

Summary

User reports Qwen2.5 32B at 37 tokens per second on an RTX 5090. No engine, quant, context length or KV cache settings are stated. The user is an amateur and has not collected full benchmarks yet, and may post more results later.