LFM3 1.7B
on NVIDIA RTX 4060 Laptop 8GB · llama.cpp
Use cases
agentic
Summary
User asks how to run LFM3 1.7B at high concurrency locally, using llama.cpp with q8_0 KV cache and --parallel 16 --kv-unified on an RTX 4060 Laptop with 8 GB VRAM and 16 GB system RAM.
User reports that beyond about 6 concurrent sequences throughput stops scaling, and that starting a new request drops every other instance to about 1 tok/s until that request finishes prefill.
No single-stream throughput figure is given; the 1 tok/s is a per-stream rate under concurrent load.