Qwen3.8 27B
on M4 Pro 48GB · MLX
Use cases
codingmath
Summary
User reports speculative decoding with mlx-dspark on an 8-bit target at a 2.45x mean speedup, 8.3 to 20.3 tok/s.
Setup is mlx-dspark with a 4-bit target at 1.74x and 25.3 tok/s.
The 8-bit target with drafter beats plain 4-bit at 14.6 tok/s.