- generation:
- 17.0 tokens/s
User reports Qwen3.5 35B A3B running at roughly 17 t/s on a MacBook Pro M5 16GB. Setup uses slotstream; no engine, quant or context length stated. The figure is given as approximate.
Local model performance on your hardware
Find which open-weight LLMs fit in your GPU or Mac and compare the speeds people report on setups like yours.
Join the community
What runs on your hardware?
Pick your GPU or Mac, then read the speeds people reported on it, or estimate which models fit and how fast they run.
Free to use. No account needed. Memory estimates and community measurements are labelled separately.
Looking for a particular model?
Search for a model to see its reported speeds across GPUs and Macs.
Local model performance reports from the community
These are individual setups, not a controlled benchmark. Compare GPU count, quantization, context and offloading before comparing speeds. How to read a report →
GPU: M5 16GB
Compare setup details
Exact recorded values. Context may be a configured limit; matching filters does not establish identical prompts, offloading or concurrency.
Qwen3.8 27B
M5 16GB · llama.cpp · 8,192 ctx
- generation:
- 9.0 tokens/s
- quant:
- Q3_xxs
- kv:
- 8
summarization
User asks whether about 9 t/s is normal for their setup, and is new to local LLMs. User also asks for model recommendations for PDF summaries on 16 GB of RAM.
Showing 1–2 of 2
Page 1 of 1
Community benchmarks snapshot
Records by GPU
Records by model
Qwen3.81215
Qwen3.6274
Gemma 4165
DeepSeek V4 Flash148
Qwen3.5116
Qwen371
other595
Records by engine
llama.cpp983
vLLM201
Strata132
MLX106
Ollama79
other407
Use cases
coding 685agentic 434long-context 323tool-use 189vision 126summarization 61math 51creative-writing 43multilingual 26rp 12text-generation 9reasoning 3
Median generation t/s by GPU
On Qwen3.8 27B at 4-bit, plain single-GPU runs. Full ranking