DeepSeek V4
M1 Ultra 128GB · LM Studio
- generation:
- 16.0 tokens/s
- quant:
- IQ3_XXS
User reports a patched engine improved speed from 5-6 to 15-16 tok/s. Setup uses the Unsloth UD-IQ3_XXS quant. The user notes a wired limit at 120GB.
Local model performance on your hardware
Find which open-weight LLMs fit in your GPU or Mac and compare the speeds people report on setups like yours.
Join the community
What runs on your hardware?
Pick your GPU or Mac, then read the speeds people reported on it, or estimate which models fit and how fast they run.
Free to use. No account needed. Memory estimates and community measurements are labelled separately.
Looking for a particular model?
Search for a model to see its reported speeds across GPUs and Macs.
Local model performance reports from the community
These are individual setups, not a controlled benchmark. Compare GPU count, quantization, context and offloading before comparing speeds. How to read a report →
GPU: M1 Ultra 128GB
Compare setup details (1 active)
Exact recorded values. Context may be a configured limit; matching filters does not establish identical prompts, offloading or concurrency.
Showing 1–1 of 1
Page 1 of 1
Community benchmarks snapshot
Records by GPU
Records by model
Qwen3.81268
Qwen3.6282
Gemma 4168
DeepSeek V4 Flash149
Qwen3.5121
Qwen375
other624
Records by engine
llama.cpp1007
vLLM205
Strata148
MLX106
Ollama83
other425
Use cases
coding 731agentic 465long-context 340tool-use 207vision 134summarization 61math 57creative-writing 46multilingual 29rp 13text-generation 9reasoning 3
Median generation t/s by GPU
On Qwen3.8 27B at 4-bit, plain single-GPU runs. Full ranking