Qwen3.8 27B
on M5 Pro 48GB · oMLX
Summary
User reports Qwen3.8 27B running at 10-20 tok/s on an M5 Pro Mac Mini with 48GB RAM, below the 30-50 tok/s they expected from community optimizations.
Setup is oMLX 0.70 with both 4-bit and 8-bit models; the 4-bit run took 40 minutes on a lengthy command and the 8-bit run progressed only 5% in over 10 minutes before being cancelled.
The user asks whether this performance is expected for their hardware.