Find which open-weight LLMs fit in your GPU or Mac and compare the speeds people report on setups like yours.
Pick your GPU or Mac, then read the speeds people reported on it, or estimate which models fit and how fast they run.
Free to use. No account needed. Memory estimates and community measurements are labelled separately.
Search for a model to see its reported speeds across GPUs and Macs.
These are individual setups, not a controlled benchmark. Compare GPU count, quantization, context and offloading before comparing speeds. How to read a report →
Exact recorded values. Context may be a configured limit; matching filters does not establish identical prompts, offloading or concurrency.
User compares Nemotron 3.5 Super VL 120B-A12B at 31 t/s against Qwen 3.8 27B at 15 t/s on an AMD Strix Halo 128GB. Setup is LM Studio on Windows 11, with the Nemotron in Q4_K_M and the Qwen in Q8_0. Both models were asked to write a single canvas HTML animation explaining noise cancelling headphones; the user says the Nemotron result is clearly better and hits above its weight class. Nemotron thought for 7 minutes, Qwen for 20.
AMD Strix Halo 128GB · LM Studio · 131,072 ctx
User benchmarks 12 local models on a Ryzen AI MAX+ 395 with Radeon 8060S and 128 GB unified memory, scoring four tasks (reasoning, management analysis, coding, MCP tool use) out of 100. Setup is LM Studio with GGUF files at a configured 131,072-token context; speeds are observed generation rates, not end-to-end latency. Gemma 4 26B-A4B QAT Q4_0 and Qwen3.8 27B Q6_K tie at 90/100, at 52-54 t/s and 15-17 t/s respectively; Qwen3.8 was the only model that checked an existing file before overwriting it. GPT-OSS 120B MXFP4 scored 87 at 29-30 t/s with partial GPU offloading. Each model was run once per task and scores are subjective rubric evaluations.
AMD Strix Halo 128GB · LM Studio
User reports Qwen3.8 27B at 26.47 t/s on a GMKtec NucBox EVO-X2 with AMD Ryzen AI Max+ 395 (Strix Halo) and 128 GB LPDDR5X-8000. Setup is LM Studio's llama.cpp Vulkan build with Q4_K_M (lmstudio-community, 16.80 GB) and the model's built-in MTP speculative-decoding head on, thinking off. Other quants measured with MTP: UD-Q4_K_XL (unsloth, 17.92 GB) 26.26 t/s, UD-Q8_K_XL (unsloth, 31.45 GB) 15.20 t/s, BF16 (unsloth, 54.66 GB) 10.50 t/s. Memory bandwidth measured at about 239 GB/s.
AMD Strix Halo 128GB · LM Studio · 262,144 ctx
User reports Qwen3.8 27B at roughly 5–6 t/s on Strix Halo with max GPU offload. Setup is Windows + WSL2 + Docker, LM Studio with the Q4_K_M GGUF, Open WebUI frontend, and 262K context with context compaction enabled. The user calls the experience poor: refining a 12-slide deck repeatedly stalled for minutes and returned nothing across 3–4 retries, and asks whether the model, the 262K context, LM Studio, Open WebUI, or the stack is at fault.
On Qwen3.8 27B at 4-bit, plain single-GPU runs. Full ranking