gpt-oss 117B (5.1B active)
on M1 Ultra 128GB · llama.cpp b6470 / a0e13dcb / Metal
Summary
User reports gpt-oss 120B MXFP4 at 65.5 t/s generation and 392.4 t/s prompt processing on a Mac Studio M1 Ultra with 128 GB unified memory.
Setup is llama.cpp build 6470 with MXFP4 and F16 K/V cache, one Metal device, all layers offloaded, batch and microbatch 4096, mmap disabled.
The two figures are separate synthetic tests, not one 65536-input/128-output request: prompt processing ran 65536 tokens and generation 128 tokens at depth 0, so generation is not measured at 65K depth.