llamaperf

RTX 4080 vs RTX 5060 Ti 16GB

For running local LLMs · 1 report across 1 model

Side A
RTX 4080
Vendor
nvidia
VRAM
16GB
Memory
Discrete
Side B
RTX 5060 Ti 16GB
Vendor
nvidia
VRAM
16GB
Memory
Discrete

Tokens per second by model

ModelRTX 4080RTX 5060 Ti 16GB
Gemma 4up to 31B45.0n=1

More comparisons