llamaperf

gpt-oss 21B (3.6B active)

on M4 Pro 64GB · llama.cpp b6280 / 0fd90db / Metal

Apple hardware
Oct 14, 2026
Throughput
63.3 t/s gen · 700.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
MXFP4 (GGUF)
Flash Attention
on
MTP (Multi-Token Prediction)
off
System RAM
64 GB

Summary

User reports gpt-oss 20B MXFP4 at 63.3 t/s generation and 700.8 t/s prompt processing on a Mac mini M4 Pro with 64 GB unified memory. Setup is llama.cpp build 6280 with MXFP4 GGUF, F16 K/V cache, flash attention, one Metal device, and -ngl 99. The 63.3 t/s is a separate TG128 depth-zero test, not generation after the four large prompts; prompt rates fall from 700.78 t/s at 2048 tokens to 419.74 t/s at 32768.