Summary
User reports Gemma 4 E4B at 78.3 t/s generation and 1236 t/s prompt processing on a single M4 Pro Mac mini with 64 GB unified memory.
Setup is MLX 0.32.0 with MLX-LM 0.31.3, an affine mixed 3.40 bpw text-only conversion, batch 1, greedy temperature 0, thinking enabled.
Source medians are 1,236.00 PP and 78.32 TG over 2,048 prompt tokens and 235 generated tokens; ranges are 1,233.55-1,236.60 PP and 78.22-78.52 TG. The author reports quality losses versus its bf16 comparator, including MMLU-Pro-400 -9 percentage points.