Ornith1.5 35B (3B active)
on M2 Max 32GB · oMLX
Summary
User reports Ornith 1.5 35B-A3B at 108 tok/s on an M2 Max 32GB, versus 66 tok/s with the macOS Aerial lock-screen animation playing.
Setup is oMLX with a 4-bit MoE model, medians of 4-6 local runs over 512 output tokens.
After an 8k-token prompt, generation was 89 vs 66 tok/s, and WindowServer CPU use rose from roughly 25% to 44% while the animation ran. Using caffeinate -i instead of -d let the display sleep and restored speed.