Summary
User reports Gemma 4 E4B at 25.6–28.3 tok/s on an M4 alone, with TTFT of about 0.31 s on a 71-token prompt.
Setup is Ollama with 4-bit weights; a distributed run across the M4 and an RTX 3060 6 GB over Wi-Fi reached about 8 tok/s with layers 0–14 on the M4 and 14–42 on the RTX, and about 10.2 tok/s with layers 0–4 on the M4 and 4–42 on the RTX.
Gemma 4 E2B runs at 42.8 tok/s on the M4 alone, up from about 11.5 tok/s before optimising the decode path. The user notes that adding a second machine does not automatically speed up inference and is exploring task-level rather than layer-level distribution.