AnyLanguageModel is a drop-in replacement for Apple's Foundation Models framework: change the import and the same sessions, tools and guided generation work with other models. Providers include Apple's on-device model, Core ML, MLX, llama.cpp (GGUF), Ollama, and the Anthropic, Gemini and OpenAI APIs.
Backends are opt-in Swift package traits (CoreML, MLX, Llama), so an app only pulls in what it uses. It needs Swift 6.3 (Xcode 26.4) and supports macOS 14.0, iOS 17.0, visionOS 1.0 and Linux.
It's free and open source (Apache 2.0). With local backends the model runs on the device; with a cloud provider, prompts go to that provider.
Official downloads only. MLX never re-hosts an app, and never runs a command for you.
Ranked against the developer tools listings, from real public data only. How the score works.
AnyLanguageModel is a product of Hugging Face; MLX isn’t affiliated with it. Something wrong? Write to support@mlx.app.