llamaperf

NVIDIA A30

NVIDIA · 24GB · 0 reports

Is this your card?

Run models on your NVIDIA A30? Add your numbers.

Your coding agent can run a speed test on your machine and send it here with a free account. Or paste a result you've already posted.

Reported performance on the NVIDIA A30

These reports mix GPU counts and memory setups, so a model listed here may have needed extra cards or CPU offloading. The calculator estimates which models fit in 24 GB of VRAM. Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.

No reports yet for the NVIDIA A30.

Be the first to submit

Get a weekly email of new NVIDIA A30 reports and newly released models that fit it.

Email me new reports