LFM3 1.7B
on Unknown GPU · llama.cpp
Use cases
agentic
Summary
User asks what model fits a 16GB DDR3 system (i7 3770, 1600MT dual-channel, 5400RPM HDD) and how to run it faster as an agent.
They ran LFM3 1.7B Q4 (about 1GB) in llama.cpp at around 12 tok/s, slowing as the chat grows, and Nanbeige 4.2 3B starting near 3.5 tok/s and dropping below 1 tok/s; they also tried Qwen 3 8B and found the models poor as agents and wasteful of tokens.
No GPU is named, so the runs are CPU-only; the user notes their RAM is theoretically 25.6GB/s and asks about 2-bit Qwen 4 27B and upcoming Nanbeige 4.5.