Instinct MI300X 192GB vs M5 Max 128GB

For running local LLMs · 2 reports across 2 models

Side A

Instinct MI300X 192GB

Vendor: amd
VRAM: 192GB
Memory: Discrete

Side B

Vendor: apple
VRAM: 128GB
Memory: Unified

Tokens per second by model

Model	Instinct MI300X 192GB	M5 Max 128GB
Gemma 4up to 31B	—	7.5n=1
Qwen3.6up to 35B	—	5.5n=1

More comparisons