AMD Threadripper 256GB vs H100 80GB

Name: H100 80GB
Brand: nvidia

For running local LLMs · 5 reports across 2 models

Side A

Side B

Tokens per second by model

Model	AMD Threadripper 256GB	H100 80GB
Gemma 4up to 31B	8.8n=4	—
Qwen3.6up to 35B	—	45.0n=1