llamaperf

M6 32GB

APPLE · 32GB unified memory · 22 reports

Is this your card?

On the M6 32GB, Gemma 3 27B at 4-bit, the model most run on it, generates a median of 8.9 tokens per second from one plain run (community reports, as of 22 Nov 2026).

As of 22 Nov 2026, the models most run on the M6 32GB, each one size at one quant level, with the median generation speed of its plain runs (one device, one request, no speculative decoding):

Bars are medians on one scale, 0 to 63.8 tokens/s. Press ▶ to watch text arrive at a row's speed.

Engines people use on it: LM Studio 15 (reports) · MLX 1 (reports) · Strata 1 (reports) · llama.cpp 1 (reports)

Run models on your M6 32GB? Add your numbers.

Your coding agent can run a speed test on your machine and send it here with a free account. Or paste a result you've already posted.

Reported performance on the M6 32GB

These reports mix GPU counts and memory setups, so a model listed here may have needed extra cards or CPU offloading. The calculator estimates which models fit in 32 GB of unified memory. Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.

Showing 20 of 22 reports. See all of them →

Speeds are as each source reported them. GPU count, offloading and concurrent requests change them, and prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing two reports.

Qwen3.8 27B

M6 32GB · ANEMLL Forge · 96,000 ctx

Tone: positiveApple hardware
generation:
27.0 tokens/s
prompt processing (prefill):
123.0 tokens/s
quant:
INT8
kv:
INT8

User reports Qwen3.8-27B running on the M6 Neural Engine via ANEMLL Forge 0.2.1, with about 27 tok/s decode and 123 tok/s prefill at 96K context on a 32GB M6 Mac Mini. Setup uses an INT8 K/V cache and a smaller drafter sharing the target's output head, with about 21.4 GB total memory at 96K context. Decode varies by content: JSON 35–62 tok/s, code 18–32, prose 10–17. Prefill is 260 tok/s at short context and 62 at 192K, where a smaller prefill batch of 32 rows is used. The user calls 96K the sweet spot for size and speed on 32GB.

Oct 24, 2026
Tone: positiveApple hardware
generation:
10.0 tokens/s
prompt processing (prefill):
200.0 tokens/s
quant:
Q2_0 (GGUF)

User reports Qwen3.8-Flash-Next at about 10 tok/s generation and about 200 tok/s prefill on a Mac Mini M6 with 32 GB. Setup is Strata with a Q2_0 quant at 64K context. User says quality seems on par with 4-bit Qwen3.8-27B and that the fans almost never turn on with Strata, unlike the 27B run with Splash.

Oct 23, 2026

Qwen3.8 27B

M6 32GB · Inco Splash

Tone: positiveApple hardware
generation:
33-35 tokens/s

User reports Qwen3.8 27B running at 33-35 t/s on an M6 32GB Mac using the Inco Splash inference engine. Other engines topped out at 9.6 t/s on the same machine. The user is considering an M5 Pro for its 1.7x memory bandwidth and hopes Inco AI adds support for more models like Flash-Next.

Oct 14, 2026

Gemma 3 27B

M6 32GB · MLX-LM 0.31.3 / MLX 0.32.2 / Metal

Apple hardware
generation:
8.9 tokens/s
prompt processing (prefill):
11.2 tokens/s
quant:
4-bit (MLX)

User reports Gemma 3 27B at 8.9 t/s generation and 11.2 t/s prompt processing on a Mac mini M6 with 32GB unified memory. Setup is MLX-LM with the mlx-community 4-bit quantized model, run through the mlx_lm.generate CLI with a 20-token prompt and 500 output tokens. Peak memory was 16.296 GB. The rates are native MLX-LM phase timings from a single displayed run, not a benchmark average.

Oct 13, 2026

Qwen3.5 9B

M6 32GB · LM Studio · 165,120 ctx

Apple hardware
generation:
30.3 tokens/s

User reports Qwen3.5 9B at 30.3 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with the MLX backend and a loaded context of 165,120 tokens, one machine with one model loaded alone. The 30.3 t/s is the median of three English-prose runs, a client-observed streaming decode rate rather than a pooled or peak figure; exact quantization is unknown.

Oct 13, 2026

Gemma 4 31B

M6 32GB · LM Studio · 32,768 ctx

Apple hardware
generation:
7.5 tokens/s

User reports Gemma 4 31B at 7.5 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with a 32,768-token loaded context; quantization and backend are unrecorded. The 7.5 t/s is the median of three English-prose runs, measured as client-observed streaming decode throughput rather than a pooled or peak rate.

Oct 13, 2026

Gemma 4 12B

M6 32GB · LM Studio · 32,768 ctx

Apple hardware
generation:
18.8 tokens/s

User reports Gemma 4 12B at 18.8 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with a QAT-labeled model at 32,768 tokens of loaded context; exact quantization and backend are unknown. The 18.8 t/s is the median of three English-prose runs, client-observed streaming decode throughput, not a pooled rate or prompt-processing rate.

Oct 13, 2026

Gemma 4 26B (4B active)

M6 32GB · LM Studio · 80,128 ctx

Apple hardware
generation:
48.2 tokens/s

User reports Gemma 4 26B-A4B at 48.2 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with an unreported backend and unknown quantization, loaded context 80,128 tokens, one model loaded alone. The 48.2 t/s is the median of three English-prose runs, client-observed streaming decode throughput, not a pooled rate or peak; the five workload medians range from 45.5 to 53.3 t/s.

Oct 13, 2026

gpt-oss 21B (3.6B active)

M6 32GB · LM Studio · 32,768 ctx

Apple hardware
generation:
45.2 tokens/s

User reports gpt-oss 21B-A3.6B at 45.2 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with an unreported backend and quantization, loaded at 32,768 tokens of context on one machine. The 45.2 t/s is the median of three English-prose runs and is client-observed streaming decode throughput, not a pooled rate or prompt-processing rate; the JSON extraction task reached a 53.3 t/s median.

Oct 13, 2026

Muse Glimmer

M6 32GB · LM Studio · 32,768 ctx

Apple hardware
generation:
8.6 tokens/s

User reports Muse at 8.6 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with an unknown quantization and a loaded context of 32,768 tokens on one machine. The 8.6 t/s is the median of three English-prose runs, client-observed streaming decode throughput rather than a pooled or peak rate; the JSON task passed 0 of 3 automatic checks.

Oct 13, 2026

Nemotron 3 Nano Omni

M6 32GB · LM Studio · 32,768 ctx

Apple hardware
generation:
45.0 tokens/s

User reports Nemotron 3 at 45 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with an unknown quantization and a loaded context of 32,768 tokens on one machine. The 45 t/s is the median of three English-prose runs and is client-observed streaming decode throughput, not a pooled rate or prompt-processing rate.

Oct 13, 2026

Ornith1.5 35B (3B active) Splash

M6 32GB · LM Studio · 32,768 ctx

Apple hardware
generation:
61.5 tokens/s

User reports Ornith1.5-35B-A3B Splash at 61.5 t/s on an Apple Mac mini M6 with 32GB unified memory. Setup is LM Studio with the Splash backend and 32,768 tokens of loaded context, one model loaded alone. The 61.5 t/s is the median of three English-prose runs, client-observed streaming decode throughput rather than a pooled rate or peak; the three runs measured 64.7, 59.4 and 61.5 t/s.

Oct 13, 2026

Qwen3.8 27B Splash

M6 32GB · LM Studio · 32,768 ctx

Apple hardware
generation:
20.2 tokens/s

User reports Qwen3.8-27B Splash at 20.2 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with the Splash backend, 32,768 tokens of loaded context, and speculative decoding with DFlash2 drafts; quantization is unknown. The 20.2 t/s is the median of three English-prose runs, with individual runs of 20.6, 20.2 and 20 t/s; it is client-observed streaming decode throughput, not a pooled rate or prompt-processing rate.

Oct 13, 2026

Qwen3.8 27B Swift Splash

M6 32GB · LM Studio · 32,768 ctx

Apple hardware
generation:
19.5 tokens/s

User reports Swift-Qwen3.8-27B Splash at 19.5 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with the Splash backend and speculative decoding using DFlash2 drafts, loaded at 32,768 tokens of context. The 19.5 t/s is the median of three English-prose runs and is client-observed streaming decode throughput, not a pooled rate or prompt-processing rate; exact quantization is unknown.

Oct 13, 2026

Qwen3.8 27B

M6 32GB · LM Studio · 32,768 ctx

Apple hardware
generation:
11.8 tokens/s
quant:
Q4_K_M (GGUF)

User reports Qwen3.8 27B at 11.8 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with its llama.cpp GGUF backend, GGUF Q4_K_M quantization, and a loaded context of 32,768 tokens. The 11.8 t/s is the median of three English-prose runs (Ruhr economy prompt), client-observed streaming decode throughput, not an overall mean or prefill rate.

Oct 13, 2026

Ornith1.5 35B (3B active)

M6 32GB · LM Studio · 32,768 ctx

Apple hardware
generation:
43.7 tokens/s
quant:
Q4_K_M (GGUF)

User reports Ornith1.5 35B-A3B at 43.7 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with its llama.cpp GGUF backend, GGUF Q4_K_M, and a loaded context of 32,768 tokens. The 43.7 t/s is the median of three English-prose runs (Ruhr economy prompt) and is client-observed streaming decode throughput, not an overall mean, peak speed, or prefill rate.

Oct 13, 2026
Apple hardware
generation:
42.3 tokens/s
quant:
UD-Q3_K_XL (GGUF)

User reports Nemotron 3.5 Lightning 30B-A3B at 42.3 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with its llama.cpp GGUF backend, UD-Q3_K_XL quant, and 32,768 tokens of loaded context. The 42.3 t/s is the median of three English-prose runs (Ruhr economy prompt), client-observed streaming decode throughput, not an overall mean or prefill rate.

Oct 13, 2026
Apple hardware
generation:
45.1 tokens/s
quant:
Q4_K_M (GGUF)

User reports Nemotron 3.5 Lightning 30B-A3B at 45.1 t/s on an Apple Mac mini M6 with 32 GB unified memory. Setup is LM Studio with its llama.cpp GGUF backend, GGUF Q4_K_M, and a loaded context of 32,768 tokens. The 45.1 t/s is the median of three English-prose runs and is client-observed streaming decode throughput, not an overall mean, peak, or prefill rate.

Oct 13, 2026

Qwen3.5 9B

M6 32GB · llama.cpp

Apple hardware
generation:
27.0 tokens/s
quant:
Q4_K_M (GGUF)

User reports Qwen3.5-9B at approximately 27 tokens/second decode on an Apple Mac mini M6 with 32GB unified memory. Setup is llama.cpp with Q4_K_M weights (5.5GB file) at empty prior context. The figure is from a Tweakers review sweep of prior context from empty to 90,000 tokens in 10,000-token increments; the sweep endpoint is not a verified maximum context capacity. Prefill, KV cache, offload and speculation settings are not reported for this result.

Oct 9, 2026
Apple hardware
generation:
16.2 tokens/s
prompt processing (prefill):
439.0 tokens/s
quant:
affine Q4, group size 64 (MLX)

User reports Qwen3.5-4B at 16.24 t/s generation and 438.97 t/s prefill on an Apple M6 Mac mini with 32GB unified memory. Setup is MLX 0.32.2 with MLX-LM 0.31.3, a controlled affine 4-bit (Q4) MLX package with group size 64 and 16-bit KV cache, single request, 2048 input tokens and 128 generated tokens. Measurements are from Precisit's published benchmark, not an independent rerun; decode excludes first-token production and model loading, and the 2048-token input is not a configured context limit.

Oct 8, 2026

Get a weekly email of new M6 32GB reports and newly released models that fit it.

Email me new reports

Reported configurations

Individual observations from this page, not expected speeds or a ranking. Select a model to open its report, with the source and offloading conditions. Reported context may be a limit rather than actual input length.

Model / hardwareQuant / engineReported contextGeneration
Qwen3.8 27B
M6 32GB
INT8
ANEMLL Forge
96,00027.0 tokens/s
Qwen3.8 125B (6B active) Flash-Next
M6 32GB
Q2_0
Strata
65,53610.0 tokens/s
Gemma 3 27B
M6 32GB
4-bit
MLX-LM 0.31.3 / MLX 0.32.2 / Metal
Not reported8.9 tokens/s
Qwen3.5 9B
M6 32GB
Not reported
LM Studio
165,12030.3 tokens/s
Gemma 4 31B
M6 32GB
Not reported
LM Studio
32,7687.5 tokens/s
Gemma 4 12B
M6 32GB
Not reported
LM Studio
32,76818.8 tokens/s

Frequently asked

How fast is the M6 32GB for local LLMs?

On the M6 32GB, Gemma 3 27B at 4-bit, the model most run on it, generates a median of 8.9 tokens per second from one plain run (community reports, as of 22 Nov 2026). Also reported: Gemma 4 26B · 4B active at 4-bit (52.2 t/s, one plain run); Qwen3.5 4B at 4-bit (16.2 t/s, one plain run).

What is the biggest model reported running on the M6 32GB?

The largest model with a plain generation run on the M6 32GB is Qwen3.6 35B · 3B active at 4-bit (63.8 t/s, one plain run), as of 22 Nov 2026. Plain means one device, one request, no speculative decoding, so a run split across several cards does not count.