Status: unverified against main. The companion’s source is not in this repository, so its endpoints and ports below could not be checked against code. Confirm against your installed build.

Overview

The Allternit Local Models companion runs image-generation models entirely on an Apple Silicon Mac and exposes a loopback HTTP endpoint to Allternit. No model data leaves the machine, making it suitable for private or air-gapped workflows.

Base URL

The server binds to loopback only and restricts browser access to local Allternit development and production origins.

Installation

Run the installer, then start the companion:
Installation data lives under ~/Library/Application Support/Allternit/local-models and can be removed without touching user documents.

Requirements

  • Apple Silicon Mac
  • Python 3.13 (managed by uv)
  • uv
  • At least 8 GiB of free storage
Full Xcode is not required. The installer uses a pinned, auditable upstream model runtime package and the official prebuilt MLX wheel.

Endpoints

JSON examples

Generate an image

Response:

Health check

Response:

Configuration

The companion is configured through environment variables and the installer scripts. No external API keys are required.

Error codes