llamaperf

gpt-oss 21B (3.6B active)

on M4 Pro 64GB · dasLLAMA

Apple hardware
Oct 13, 2026
Throughput
83.2 t/s gen · 862.6 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
MXFP4 (GGUF)
KV cache
F16
System RAM
64 GB

Summary

User reports gpt-oss-20b at 83.2 t/s generation and 862.6 t/s prompt processing on an Apple M4 Pro with 64 GB unified memory. Setup is dasLLAMA version 16 with MXFP4 weights, q8 activations, f16 scales and f16 KV cache, one Metal GPU with 99 layers offloaded. Figures are native PP512 and TG128 counts over five repetitions, not a single 512-input/128-output request; the session requests 640 positions of context.