Llama sits in the menu bar and runs a local server at localhost:9931. It recommends models your Mac can run, installs any GGUF model from Hugging Face in one click, and sets each one up for your Mac. Models load when asked for and unload when idle.
It's built on llama.cpp by the GGML organisation and shares its model cache. Homebrew lists it for Apple silicon Macs on macOS 15 or later.
Llama is free and open source (MIT). Models run on your Mac and no data leaves it.