AMD Threadripper 256GB

throughput:

1.3 t/s gen

quant:

Q4 (gguf)

~0.5-2 tok/s on CPU. 26B MoE painfully slow on CPU. Source: gemma4-ai.com hardware guide

throughput:

3.5 t/s gen

quant:

Q4 (gguf)

~2-5 tok/s on CPU. E4B usable but slow. Source: gemma4-ai.com hardware guide

throughput:

7.5 t/s gen

quant:

Q4 (gguf)

~5-10 tok/s on CPU. E2B is usable CPU-only. Source: gemma4-ai.com hardware guide

throughput:

8.8 t/s gen · 45.3 t/s pp

quant:

GGUF (gguf)

CPU-only, no GPU. Outperformed 4090 for 31B gen speed (8.8 vs 7.8 t/s) due to no VRAM bottleneck. Source: n1n.ai