Gemma 4 26B (4B active)
on M5 Max 64GB · llama.cpp
Use cases
coding
Summary
User reports Gemma 4 26B at 97 tokens/s in llama.cpp on a MacBook Pro M5 Max.
Setup is GGUF weights, with a prompt asking for a recursive Python Fibonacci program.
With the user's Multi-Token Prediction (MTP) implementation for llama.cpp and quantized Gemma 4 assistant draft models, the same prompt runs at 138 tokens/s, which the user calls 40% faster.