Qwen3.8 27B
on M4 Max 128GB · mlx-serve
Oct 17, 2026
Summary
User reports Qwen3.8 27B (abliterated) at ~43 tok/s on an M4 Max 128GB.
Setup is mlx-serve 26.10.2 with MTP enabled; the 27B build is 16GB.
The user also lists other abliterated models in their picker: Smart 35B at ~106 tok/s (24GB), Vision 27B at ~22 tok/s (15GB), Coder 80B at ~78 tok/s (49GB), DeepSeek-V4-Flash 284B at ~26 tok/s (75GB), and Flash-Next 125B at ~90 tok/s (77GB). They ask for suggestions on better packs and MTP or mlx-serve settings for this hardware.