Find which open-weight LLMs fit in your GPU or Mac and compare the speeds people report on setups like yours.
Pick your GPU or Mac, then read the speeds people reported on it, or estimate which models fit and how fast they run.
Free to use. No account needed. Memory estimates and community measurements are labelled separately.
Search for a model to see its reported speeds across GPUs and Macs.
These are individual setups, not a controlled benchmark. Compare GPU count, quantization, context and offloading before comparing speeds. How to read a report →
Exact recorded values. Context may be a configured limit; matching filters does not establish identical prompts, offloading or concurrency.
AMD RX 7900 XT · LM Studio
User reports running Gemma 4 26B (MoE) locally at around 75-90 tok/s on an AMD Radeon RX 7900 XT with 20 GB VRAM. Setup is LM Studio with ROCm on Windows 10 Pro, with a Ryzen 7 7700X and 32 GB DDR5; the phone UI connects over Tailscale. The speed is given only as a range, and the post is mainly about the mobile-first agentic web UI with tool calling for file edits, PowerShell commands and web search.
AMD RX 7900 XT · LM Studio
User reports about 7 t/s running Qwen3.8 27B Uncensored on an RX 7900 XT 20GB with 32GB DDR5 and a Ryzen 5 7600X. Setup used Hermes with LM Studio as a server, Q8 KV cache to fit the model in 20GB VRAM; the initial Hermes default configuration offloaded most work to CPU. User says the experience was poor, with overthinking loops and slow responses, and asks whether the hardware is the problem or their configuration.
On Qwen3.8 27B at 4-bit, plain single-GPU runs. Full ranking