RTX 4070 vs RTX A6000 48GB
For running local LLMs · 6 reports across 1 model
Tokens per second by model
| Model | RTX 4070 | RTX A6000 48GB |
|---|---|---|
| Gemma 4up to 31B | 55.0n=2 | 16.9n=4 |
For running local LLMs · 6 reports across 1 model
| Model | RTX 4070 | RTX A6000 48GB |
|---|---|---|
| Gemma 4up to 31B | 55.0n=2 | 16.9n=4 |