llamaperf

Qwen3.8 27B

on M4 Pro 48GB · MLX

Tone: positiveApple hardware
Sep 7, 2026
Throughput
20.3 t/s gen
System RAM
48 GB

Use cases

codingmath

Summary

User reports speculative decoding with mlx-dspark on an 8-bit target at a 2.45x mean speedup, 8.3 to 20.3 tok/s. Setup is mlx-dspark with a 4-bit target at 1.74x and 25.3 tok/s. The 8-bit target with drafter beats plain 4-bit at 14.6 tok/s.