Gemma 3 27B

on M6 32GB · MLX-LM 0.31.3 / MLX 0.32.2 / Metal

Oct 13, 2026

Throughput

8.9 t/s gen · 11.2 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

4-bit (MLX)

System RAM

32 GB

Summary

User reports Gemma 3 27B at 8.9 t/s generation and 11.2 t/s prompt processing on a Mac mini M6 with 32GB unified memory. Setup is MLX-LM with the mlx-community 4-bit quantized model, run through the mlx_lm.generate CLI with a 20-token prompt and 500 output tokens. Peak memory was 16.296 GB. The rates are native MLX-LM phase timings from a single displayed run, not a benchmark average.