llamaperf

LFM3 1.7B

on NVIDIA RTX 4060 Laptop 8GB · llama.cpp

Tone: mixedNVIDIA hardware
Oct 28, 2026
Throughput
1.0 t/s gen
KV cache
q8_0
System RAM
16 GB
VRAM reported
8 GB

Use cases

agentic

Summary

User asks how to run LFM3 1.7B at high concurrency locally, using llama.cpp with q8_0 KV cache and --parallel 16 --kv-unified on an RTX 4060 Laptop with 8 GB VRAM and 16 GB system RAM. User reports that beyond about 6 concurrent sequences throughput stops scaling, and that starting a new request drops every other instance to about 1 tok/s until that request finishes prefill. No single-stream throughput figure is given; the 1 tok/s is a per-stream rate under concurrent load.