Find which open-weight LLMs fit in your GPU or Mac and compare the speeds people report on setups like yours.
Pick your GPU or Mac, then read the speeds people reported on it, or estimate which models fit and how fast they run.
Free to use. No account needed. Memory estimates and community measurements are labelled separately.
Search for a model to see its reported speeds across GPUs and Macs.
These are individual setups, not a controlled benchmark. Compare GPU count, quantization, context and offloading before comparing speeds. How to read a report →
Exact recorded values. Context may be a configured limit; matching filters does not establish identical prompts, offloading or concurrency.
2× AMD RX 6800 16GB · llama.cpp · 131,072 ctx
User runs Qwen3.8 27B IQ4_XS at 131k context on two RTX 2060 12GB cards, 24 GB total, and gets about 45 t/s. Setup is llama.cpp. User asks whether an upgrade to an RX 6800 16GB plus an RX 6800 XT 16GB, 32 GB total, would improve performance and how ROCm and Vulkan support compare.
On Qwen3.8 27B at 4-bit, plain single-GPU runs. Full ranking