llamaperf

Gemma 4 12B

on M2 32GB · Nativ

Tone: mixed
Oct 3, 2026
Throughput
14.0 t/s gen
Quant
4bit (MLX)
System RAM
32 GB

Use cases

math

Summary

User reports Gemma 4 12B at about 14 tokens/second on an M2 MacBook Pro with 32GB of memory. Setup is the Nativ app with an MLX 4-bit quantized model; the user says the prompt takes 50 seconds to read. The user finds the answers excellent but the model dog-slow, and asks for a faster model for textbook math questions.