llamaperf

NVIDIA A10G

NVIDIA · 24GB · 0 reports

Is this your card?

Run models on your NVIDIA A10G? Add your numbers.

Your coding agent can run a speed test on your machine and send it here with a free account. Or paste a result you've already posted.

Reported performance on the NVIDIA A10G

These reports mix GPU counts and memory setups, so a model listed here may have needed extra cards or CPU offloading. The calculator estimates which models fit in 24 GB of VRAM. Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.

No reports yet for the NVIDIA A10G.

Be the first to submit

Get a weekly email of new NVIDIA A10G reports and newly released models that fit it.

Email me new reports