LFM2.5 0.23B 0.2B
on Unknown GPU · llama.cpp
Summary
User reports LFM2.5-230M at 192.34 t/s generation and 1611.26 t/s prefill on a Xiaomi 14T Pro phone.
Setup is llama.cpp (build 96ffdc41c) running CPU only with 8 threads, the Q4_0 GGUF, and a q8_0 KV cache, measured with llama-bench at 256 prompt and 256 generation tokens over 10 runs.