LFM3 1.7B
on A18 Pro 8GB · MLX · 8,192 ctx
Use cases
vision
Summary
User reports LFM3-1.7B at about 40 tok/s on an iPhone 16 Pro, with first token under 0.5 s.
Setup is MLX 4-bit on the Apple GPU; the export is 1.07 GB and context goes to 8192 tokens.
LFM3-VL-2B with a photo takes about 9 s to first token and about 20 tok/s decode, with a text follow-up starting in about 5 s. A CPU build (XNNPACK 8da4w, 1.17 GB) runs on iOS and Android.