mlx-lm runs language models from Hugging Face with Apple's MLX. It can generate and chat, convert and quantize models and upload them, fine-tune them with LoRA or in full, and serve a basic OpenAI-style endpoint.
It runs on Apple silicon. It's built on MLX, which needs macOS 14.0 or later and a native Python 3.10 or newer. Thousands of ready-converted models are in the mlx-community organisation on Hugging Face.
It's free and open source (MIT) and runs on your Mac.
Official downloads only. MLX never re-hosts an app, and never runs a command for you.
Ranked against the run models locally listings, from real public data only. How the score works.
mlx-lm is a product of Apple (ml-explore); MLX isn’t affiliated with it. Something wrong? Write to support@mlx.app.