llamaperf

Gemma 4 26B (4B active)

on M4 Pro 48GB · Rapid-MLX

Apple hardware
Oct 11, 2026
Throughput
78.5 t/s gen
Quant
4-bit (MLX)
VRAM reported
48 GB

Summary

User reports Gemma 4 26B-A4B at 78.5 t/s on an M4 Pro with 48 GB unified memory. Setup is Rapid-MLX 0.15.4 with MLX 4-bit on one Mac mini, vision disabled, decoding a 512-token workload. The figure is single-stream, a median of three runs at temperature 0; a separate four-stream result of 121.6 t/s is aggregate and not single-request speed.