llamaperf

MiniCPM-V 4.7 35B (3B active)

on Unknown GPU

Tone: positive
Oct 14, 2026
Throughput
13.0 t/s gen

Use cases

visionlong-context

Summary

User reports MiniCPM-V 4.7, a 35B-A3B MoE vision model, running at 13+ tok/s on an iPhone 17 Pro Max with a 3GB inference memory footprint. Experts are streamed from flash storage using Lookahead Expert Scheduling (LES), which predicts upcoming expert needs and overlaps loading with computation. The 3GB figure is the inference memory footprint; the app README lists a ~16.6GB download and recommends at least 12GB of device RAM. A smaller 1B version exists, and code and weights are Apache 2.0.