llamaperf

Ornith1.5 35B (3B active)

on M2 Max 32GB · oMLX

Apple hardware
Oct 21, 2026
Throughput
108.0 t/s gen
Quant
4-bit (MLX)
System RAM
32 GB

Summary

User reports Ornith 1.5 35B-A3B at 108 tok/s on an M2 Max 32GB, versus 66 tok/s with the macOS Aerial lock-screen animation playing. Setup is oMLX with a 4-bit MoE model, medians of 4-6 local runs over 512 output tokens. After an 8k-token prompt, generation was 89 vs 66 tok/s, and WindowServer CPU use rose from roughly 25% to 44% while the animation ran. Using caffeinate -i instead of -d let the display sleep and restored speed.