llamaperf

LFM3 2B VL

on Snapdragon X Elite X1E-78-100 · GenieX

Tone: positive
Oct 28, 2026
Throughput
32.3 t/s gen · 1616.1 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_0 (GGUF)
System RAM
64 GB

Summary

User reports LFM3-VL 2B at 32.3 t/s decode and 1616.1 t/s prefill on the Hexagon NPU of a Snapdragon X Elite X1E-78-100 laptop with 64 GB RAM. Setup is GenieX with Q4_0 GGUF weights, comparing NPU, hybrid NPU+CPU, Adreno OpenCL GPU and ARM CPU backends. The NPU doubles CPU prefill at 12 W versus 35-60 W, but decode is about half the CPU's 66.5 t/s. Gemma 4 E2B, Gemma 4 26B MoE and Gemma 4 31B were also run on the NPU.