A 3B parameter on-device LLM is now exposed to third-party apps via a new Swift framework.
iOS 19 ships Apple's 3B parameter on-device foundation model, accessible to any app via the new FoundationModels framework. Developers get streaming generation, structured output, and tool calling - all running locally with no network round-trip. Apple is positioning the API as a privacy-first alternative to cloud LLM calls.