Production ready toolkit to run AI locally
-
Updated
Mar 2, 2026 - C++
Production ready toolkit to run AI locally
AI edge infrastructure for macOS. Run local or cloud models, share tools across apps via MCP, and power AI workflows with a native, always-on runtime.
Example apps for Foundation Models Framework in iOS 26 and macOS 26
Playground examples to demonstrate Foundation Models Framework
React Native Apple LLM plugin using Foundation Models
Decrypted Generative Model safety files for Apple Intelligence containing filters
'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and other APIs running on your Mac through a single aggregated OpenAI-compatible API endpoint. Supports Apple Vision and single command (non-server) inference with piping as well . Now with Web Browser and local AI API aggregator
macOS menu bar app that exposes Apple's on-device Foundation Models as an OpenAI-compatible local API. Zero cloud. Zero dependencies.
Custom implementation of Apple Intelligence features
A C library for embedding Apple Intelligence on-device Foundation models in any programming language or application with full support for native tool calling and MCP.
Autocorrection, synonym suggestions for the word under the cursor, and rephrasing of the selected text. All with one key press.
Lightweight, intent-driven control plane for smart home & local automation. Uses iOS Shortcuts & Control URLs without local LLM/GPU hosting.
This is for EMNLP 2024 Paper: AppBench: Planning of Multiple APIs from Various APPs for Complex User Instruction
Read Hacker News on your iPhone, iPad, and Apple Watch, with features such as widgets and dark mode.
A Swift command-line interface tool for interacting with macOS Apple Intelligence foundation models.
Super-simple API for working with Foundation Models in Swift
Make Apple's Foundation Models accessible over web APIs
Add a description, image, and links to the apple-intelligence topic page so that developers can more easily learn about it.
To associate your repository with the apple-intelligence topic, visit your repo's landing page and select "manage topics."