Instinct MI300X 192GB vs RTX 4060 Ti 16GB
For running local LLMs · 4 reports across 1 model
Tokens per second by model
| Model | Instinct MI300X 192GB | RTX 4060 Ti 16GB |
|---|---|---|
| Gemma 4up to 31B | — | 45.0n=4 |
For running local LLMs · 4 reports across 1 model
| Model | Instinct MI300X 192GB | RTX 4060 Ti 16GB |
|---|---|---|
| Gemma 4up to 31B | — | 45.0n=4 |