ancientcomputing/locallm
Free Swift SDK for adding on-device AI, tools and MCP servers to a Mac app. Apple’s on-device model, open-weight models (MLX) and hosted models behind one API, with a security gate on every tool call.
- Stars
- 8
- Gained, 7 days
- n/a
- Gained, 30 days
- n/a
- Reddit posts
- 3
Swift · Apache-2.0 · last push 2026-11-20 · created 2026-07-11
GitHub stars, last 90 days
We read stars once a day, so the chart starts after the second reading.
Does it work with local models?
Reports from people who ran it with a model on their own hardware. Tool calling depends on the model as much as on the server, so say which model and quant you used.
No reports yet.
Add your report
Sign in to say whether it worked for you.
Reddit posts linking it
- Looking for a 2026-07-28 protocol MCP server for testingr/mcp · 2026-09-14
- LocalLM Lab 1.0.0-beta -> build your app on open-weight models running fully locallyr/LocalLLM · 2026-09-03
- The MCP client I built for Apple's on-device model is a linkable SDK and it builds a Tool at runtime straight from any MCP server's own JSON Schema, no adapter to write yourselfr/mcp · 2026-08-27
In the official MCP registry
No registry entry points at this repository, so how it runs is not listed here. Check its README.