Local model performance on your hardware

generation:

122.7 tokens/s

quant:

4bit (MLX)

User benchmarks Qwen3.6-35B-A3B at 122.7 tok/s on an M3 Max 36GB with Kapitsa 0.2.12, tying oMLX at 122.9 tok/s. Setup is Kapitsa with a 4-bit MLX build and MTP head plus DFlash2 drafter, sustained 256-token prose, median of 3 runs. Other engines on the same model: Rapid-MLX 110.3, Splash 97.0, MTPLX 79.9 tok/s. On dense Qwen3.8-27B-4bit Kapitsa leads at 41.3 tok/s, ahead of oMLX 34.1, Splash 33.0, MTPLX 31.6 and Rapid 26.2. Flint 40B-A2.5B reaches 134.2 tok/s on Kapitsa and 103.0 on Rapid. Draft acceptance was 75-78% dense and 81-85% MoE. No formal quality eval was run.

generation:

110.2 tokens/s

prompt processing (prefill):

1200-1300 tokens/s

quant:

4bit (MLX)

User benchmarks four MLX engines on a 14" M3 Max MacBook Pro (36 GB) across Qwen3.6-35B-A3B and Qwen3.8-27B at 4-bit. Rapid-MLX leads the MoE at 110.2 tok/s decode, while Splash leads the dense 27B at 31.7 tok/s (MTPLX 31.5, effectively a tie). oMLX trails on dense at 17.9 tok/s but is level with the leaders on the MoE at 104.2 tok/s. Each engine used its own weight build: Rapid and MTPLX ran MTP-augmented 4-bit builds, Splash paired its own DFlash2 draft, and oMLX ran the plain mlx-community 4-bit. Sustained test was 3 runs x 256 output tokens, median, temperature 0, thinking off. User kept Rapid-MLX because the MoE is their daily model. Qwen3.8-Flash-Next (125B) does not fit on 36 GB.