MiniCPM-V 35B (3B active) 4.7
on M4 16GB
Use cases
visionmultilingual
Summary
User reports MiniCPM-V 4.7 35B-A3B at 17+ tok/s on an iPad Pro M4 16GB, with 13+ tok/s on an iPhone 17 Pro Max and about 3GB memory usage.
Setup details are not stated; the post highlights the model's LES (Lookahead Expert Scheduling) technique for MoE models, claimed to give up to 5x speedup with identical outputs.
The post also cites 90.4 OCRBench with 16x visual compression, 34 multimodal benchmarks, a new 1B lightweight VLM, Self-Replay Fine-Tuning, and support for Apple, Intel, AMD, Arm and Rockchip.