llamaperf

Qwen3.6 35B (3B active)

on M5 Max 64GB · dflash-mlx · 32,768 ctx

Apple hardware
Oct 4, 2026
Throughput
121.2 t/s gen
Quant
4bit (MLX)
System RAM
64 GB

Summary

User benchmarks dflash-mlx at 121.2 t/s decode on a 32,768-token prompt, the fastest of four MLX frameworks tested on an Apple M5 Max with 64 GB unified memory. Setup is dflash-mlx v0.1.7 with the 4-bit MLX Qwen3.6-35B-A3B model and a companion draft model for speculative decoding, single sequence, prefix caching disabled, cooldown=60 between runs. Decode medians across the ladder: 148.7 t/s at 64 tokens, 138.9 at 512, 154.5 at 2,048, 127.7 at 4,096, 124.6 at 8,192, 119.0 at 16,384, and 121.2 at 32,768. TTFT at 32K is 8.1 s. The other three frameworks were tested at cooldown=2 and would score higher at the longer cooldown.