LFM2.5 1.2B

on NVIDIA RTX 4050 6GB · LM Studio · 256,000 ctx

Aug 28, 2026

Throughput

129.0 t/s gen · 8500.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

VRAM reported

6 GB

Use cases

tool-usesummarization

Summary

User benchmarks 20 small models on an RTX 4050 6GB. Models tested include Granite 4.1 3B, Gemma-4-agentic-e2b, Nemotron-3-Nano-4B and LFM2.5-8B-A1B. The user selects LFM2.5-1.2B-Instruct as a cheap always-on model.

View source ↗