DeepSeek V4.1 Flash 552B (16B active)
on M2 Max 64GB · Whallm
Summary
User reports DeepSeek V4.1 Flash at 1.8-2.2 t/s on an M2 Max 64GB.
Setup is the Whallm app with MLX, loading parts of the model from SSD, around 33 GiB peak MLX memory, with 1K-16K input tokens.
The app also adds built-in throughput benchmarks and an OpenAI-compatible API.