llamaperf

Qwen3.6 35B (3B active)

on M3 Max 36GB · Rapid-MLX

Tone: mixedApple hardware
Oct 5, 2026
Throughput
110.2 t/s gen · 1200-1300 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
4bit (MLX)
System RAM
36 GB

Summary

User benchmarks four MLX engines on a 14" M3 Max MacBook Pro (36 GB) across Qwen3.6-35B-A3B and Qwen3.8-27B at 4-bit. Rapid-MLX leads the MoE at 110.2 tok/s decode, while Splash leads the dense 27B at 31.7 tok/s (MTPLX 31.5, effectively a tie). oMLX trails on dense at 17.9 tok/s but is level with the leaders on the MoE at 104.2 tok/s. Each engine used its own weight build: Rapid and MTPLX ran MTP-augmented 4-bit builds, Splash paired its own DFlash2 draft, and oMLX ran the plain mlx-community 4-bit. Sustained test was 3 runs x 256 output tokens, median, temperature 0, thinking off. User kept Rapid-MLX because the MoE is their daily model. Qwen3.8-Flash-Next (125B) does not fit on 36 GB.