llamaperf

MiniCPM-V 35B (3B active) 4.7

on M4 16GB

Tone: positiveApple hardware
Oct 12, 2026
Throughput
17.0 t/s gen
System RAM
16 GB

Use cases

visionmultilingual

Summary

User reports MiniCPM-V 4.7 35B-A3B at 17+ tok/s on an iPad Pro M4 16GB, with 13+ tok/s on an iPhone 17 Pro Max and about 3GB memory usage. Setup details are not stated; the post highlights the model's LES (Lookahead Expert Scheduling) technique for MoE models, claimed to give up to 5x speedup with identical outputs. The post also cites 90.4 OCRBench with 16x visual compression, 34 multimodal benchmarks, a new 1B lightweight VLM, Self-Replay Fine-Tuning, and support for Apple, Intel, AMD, Arm and Rockchip.