llamaperf

Qwen3.8 27B

on M3 Ultra 256GB · Rapid-MLX 0.13.4 candidate

Apple hardware
Oct 9, 2026
Throughput
43.4 t/s gen
Quant
4bit (MLX)
MTP (Multi-Token Prediction)
on
System RAM
256 GB

Summary

User reports Qwen3.8 27B at 43.38 t/s generation on a Mac Studio M3 Ultra 256GB, the median of three requests with an 8,156-token prompt. Setup is Rapid-MLX 0.13.4 with the rapid-mlx MLX 4-bit MTP checkpoint, one request, with the engine's adaptive MTP on by default for this checkpoint. The source's 330.8 t/s prefill is the prompt divided by time to first token, so no prompt speed is stored. The figures come from the Rapid-MLX benchmark docs, not an independent rerun.