llamaperf

A18 Pro 8GB reports

1 report. These are individual setups, not a controlled benchmark. A18 Pro 8GB speeds and models →

Speeds are as each source reported them. GPU count, offloading and concurrent requests change them, and prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing two reports.

LFM3 1.7B

A18 Pro 8GB · MLX · 8,192 ctx

Tone: positiveApple hardware
generation:
40.0 tokens/s
quant:
4-bit (MLX)
vision

User reports LFM3-1.7B at about 40 tok/s on an iPhone 16 Pro, with first token under 0.5 s. Setup is MLX 4-bit on the Apple GPU; the export is 1.07 GB and context goes to 8192 tokens. LFM3-VL-2B with a photo takes about 9 s to first token and about 20 tok/s decode, with a text follow-up starting in about 5 s. A CPU build (XNNPACK 8da4w, 1.17 GB) runs on iOS and Android.

Oct 30, 2026