Gemma 4 26B (4B active)
on M4 Pro 48GB · Rapid-MLX
Summary
User reports Gemma 4 26B-A4B at 78.5 t/s on an M4 Pro with 48 GB unified memory.
Setup is Rapid-MLX 0.15.4 with MLX 4-bit on one Mac mini, vision disabled, decoding a 512-token workload.
The figure is single-stream, a median of three runs at temperature 0; a separate four-stream result of 121.6 t/s is aggregate and not single-request speed.