AMD Threadripper 256GB

AMD · 256GB unified memory · 1 report

Use the calculator to check which models fit in 256 GB of unified memory. The reports below include different GPU counts and memory setups; a model listed here may need extra cards or CPU offloading.

How to compare these reports →

This page is thin (1 of 3 reports needed for indexing). Help fill it in.

Latest Most reported Fastest t/s

Gemma 4 5.1B E2B Instruct

AMD Threadripper 256GB · llama.cpp

reported speed:: 7.5 tokens/s generation
quant:: Q4 (gguf)

Reported by the source; GPU count, offloading and concurrent requests can change this figure. Check the full setup before comparing.

text-generation

User reports Gemma 4 E2B at 5-10 t/s on CPU. The run is CPU-only, with no GPU involved. User considers E2B usable in this CPU-only configuration.