Speeds are as each source reported them. GPU count, offloading and concurrent requests change them, and prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing two reports.
- generation:
- 8.9 tokens/s
- prompt processing (prefill):
- 11.2 tokens/s
- quant:
- 4-bit (MLX)
User reports Gemma 3 27B at 8.9 t/s generation and 11.2 t/s prompt processing on a Mac mini M6 with 32GB unified memory.
Setup is MLX-LM with the mlx-community 4-bit quantized model, run through the mlx_lm.generate CLI with a 20-token prompt and 500 output tokens.
Peak memory was 16.296 GB. The rates are native MLX-LM phase timings from a single displayed run, not a benchmark average.
- generation:
- 30.3 tokens/s
User reports Qwen3.5 9B at 30.3 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with the MLX backend and a loaded context of 165,120 tokens, one machine with one model loaded alone.
The 30.3 t/s is the median of three English-prose runs, a client-observed streaming decode rate rather than a pooled or peak figure; exact quantization is unknown.
- generation:
- 7.5 tokens/s
User reports Gemma 4 31B at 7.5 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with a 32,768-token loaded context; quantization and backend are unrecorded.
The 7.5 t/s is the median of three English-prose runs, measured as client-observed streaming decode throughput rather than a pooled or peak rate.
- generation:
- 18.8 tokens/s
User reports Gemma 4 12B at 18.8 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with a QAT-labeled model at 32,768 tokens of loaded context; exact quantization and backend are unknown.
The 18.8 t/s is the median of three English-prose runs, client-observed streaming decode throughput, not a pooled rate or prompt-processing rate.
- generation:
- 48.2 tokens/s
User reports Gemma 4 26B-A4B at 48.2 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with an unreported backend and unknown quantization, loaded context 80,128 tokens, one model loaded alone.
The 48.2 t/s is the median of three English-prose runs, client-observed streaming decode throughput, not a pooled rate or peak; the five workload medians range from 45.5 to 53.3 t/s.
- generation:
- 45.2 tokens/s
User reports gpt-oss 21B-A3.6B at 45.2 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with an unreported backend and quantization, loaded at 32,768 tokens of context on one machine.
The 45.2 t/s is the median of three English-prose runs and is client-observed streaming decode throughput, not a pooled rate or prompt-processing rate; the JSON extraction task reached a 53.3 t/s median.
- generation:
- 8.6 tokens/s
User reports Muse at 8.6 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with an unknown quantization and a loaded context of 32,768 tokens on one machine.
The 8.6 t/s is the median of three English-prose runs, client-observed streaming decode throughput rather than a pooled or peak rate; the JSON task passed 0 of 3 automatic checks.
- generation:
- 45.0 tokens/s
User reports Nemotron 3 at 45 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with an unknown quantization and a loaded context of 32,768 tokens on one machine.
The 45 t/s is the median of three English-prose runs and is client-observed streaming decode throughput, not a pooled rate or prompt-processing rate.
- generation:
- 61.5 tokens/s
User reports Ornith1.5-35B-A3B Splash at 61.5 t/s on an Apple Mac mini M6 with 32GB unified memory.
Setup is LM Studio with the Splash backend and 32,768 tokens of loaded context, one model loaded alone.
The 61.5 t/s is the median of three English-prose runs, client-observed streaming decode throughput rather than a pooled rate or peak; the three runs measured 64.7, 59.4 and 61.5 t/s.
- generation:
- 20.2 tokens/s
User reports Qwen3.8-27B Splash at 20.2 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with the Splash backend, 32,768 tokens of loaded context, and speculative decoding with DFlash2 drafts; quantization is unknown.
The 20.2 t/s is the median of three English-prose runs, with individual runs of 20.6, 20.2 and 20 t/s; it is client-observed streaming decode throughput, not a pooled rate or prompt-processing rate.
- generation:
- 19.5 tokens/s
User reports Swift-Qwen3.8-27B Splash at 19.5 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with the Splash backend and speculative decoding using DFlash2 drafts, loaded at 32,768 tokens of context.
The 19.5 t/s is the median of three English-prose runs and is client-observed streaming decode throughput, not a pooled rate or prompt-processing rate; exact quantization is unknown.
- generation:
- 11.8 tokens/s
- quant:
- Q4_K_M (GGUF)
User reports Qwen3.8 27B at 11.8 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with its llama.cpp GGUF backend, GGUF Q4_K_M quantization, and a loaded context of 32,768 tokens.
The 11.8 t/s is the median of three English-prose runs (Ruhr economy prompt), client-observed streaming decode throughput, not an overall mean or prefill rate.
- generation:
- 43.7 tokens/s
- quant:
- Q4_K_M (GGUF)
User reports Ornith1.5 35B-A3B at 43.7 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with its llama.cpp GGUF backend, GGUF Q4_K_M, and a loaded context of 32,768 tokens.
The 43.7 t/s is the median of three English-prose runs (Ruhr economy prompt) and is client-observed streaming decode throughput, not an overall mean, peak speed, or prefill rate.
- generation:
- 42.3 tokens/s
- quant:
- UD-Q3_K_XL (GGUF)
User reports Nemotron 3.5 Lightning 30B-A3B at 42.3 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with its llama.cpp GGUF backend, UD-Q3_K_XL quant, and 32,768 tokens of loaded context.
The 42.3 t/s is the median of three English-prose runs (Ruhr economy prompt), client-observed streaming decode throughput, not an overall mean or prefill rate.
- generation:
- 45.1 tokens/s
- quant:
- Q4_K_M (GGUF)
User reports Nemotron 3.5 Lightning 30B-A3B at 45.1 t/s on an Apple Mac mini M6 with 32 GB unified memory.
Setup is LM Studio with its llama.cpp GGUF backend, GGUF Q4_K_M, and a loaded context of 32,768 tokens.
The 45.1 t/s is the median of three English-prose runs and is client-observed streaming decode throughput, not an overall mean, peak, or prefill rate.
- generation:
- 9.8 tokens/s
- quant:
- 4bit (MLX)
- mtp (multi-token prediction):
- off
summarization
User reports Qwen3.8 27B at 9.83 t/s generation on a Mac mini M6 24GB, from a 525-token prompt.
Setup is mlx-vlm 0.7.3 with the mlx-community 4-bit checkpoint, one request, speculative decoding off.
This is the plain baseline from a single run in the author's MTP comparison. The 268 t/s prefill in the source is the prompt divided by time to first token, so no prompt speed is stored.
- generation:
- 27.0 tokens/s
- quant:
- Q4_K_M (GGUF)
User reports Qwen3.5-9B at approximately 27 tokens/second decode on an Apple Mac mini M6 with 32GB unified memory.
Setup is llama.cpp with Q4_K_M weights (5.5GB file) at empty prior context.
The figure is from a Tweakers review sweep of prior context from empty to 90,000 tokens in 10,000-token increments; the sweep endpoint is not a verified maximum context capacity. Prefill, KV cache, offload and speculation settings are not reported for this result.