LFM2.5 24B (2.45B active) A2.5B

User compares LFM2.5-24B-A2B against Qwen3.6-35B-A3B on 75 multi-step tool-use tasks on an M1 Pro 32GB, with LFM2.5 solving 37/75 (49%) and Qwen 68/75 (91%). Both ran in llama.cpp b10964 with --jinja at 64k context, LFM2.5 at Q4_K_M (14.5 GB) and Qwen at Q4_K_M (22.3 GB), thinking on. LFM2.5 was faster per token (~52 vs 34 tok/s) but used about twice the tokens per solved task, 418 s per correct result vs Qwen's 328. In at least 23 of its 38 failures it reported the task as done. The user notes this is 4-bit llama.cpp rather than Liquid's vLLM setup, and that the two tie on BFCLv4.