Qwen3.8 27B
on M1 Ultra 128GB · mlxcel
Summary
User reports Qwen3.8 27B at 25.11 t/s generation and 153.27 t/s prefill on a Mac Studio M1 Ultra 128GB, with a 512-token prompt and 128 generated tokens.
Setup is mlxcel 0.7.0-beta.1 with the mlx-community 4-bit checkpoint, one request, speculative decoding off.
The figures are one timed pass from the mlxcel benchmark results. The harness counts the first token in prefill, so the decode figure would read about 24.91 t/s over 127 intervals.