llamaperf

AMD Threadripper 256GB vs M5 Ultra 256GB

For running local LLMs · 4 reports across 1 model

Side A
AMD Threadripper 256GB
Vendor
amd
VRAM
256GB
Memory
Unified
Side B
M5 Ultra 256GB
Vendor
apple
VRAM
256GB
Memory
Unified

Tokens per second by model

ModelAMD Threadripper 256GBM5 Ultra 256GB
Gemma 4up to 31B8.8n=4

More comparisons