llamaperf
Submit

Gemma 4 26B (4B active)

on M3 Ultra 512GB · mlx-vlm

Apple hardware
Oct 12, 2026
Throughput
67.6 t/s gen · 1645.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
4bit MLX (MLX)
System RAM
512 GB

Use cases

long-context

Summary

User reports Gemma 4 26B-A4B at 67.6 t/s generation and 1,645.0 t/s prompt processing on a Mac Studio with an M3 Ultra and 512 GB unified memory. Setup is mlx-vlm with 4bit MLX, run on a 36,777-token prompt with 128 generated tokens per run over three runs; both figures are medians. Peak memory was 20.0 GB and median wall time 27 seconds; the configured context cap and KV quantization are not stated.