Overview

The Allternit Local Models companion runs image-generation models entirely on an Apple Silicon Mac and exposes a loopback HTTP endpoint to Allternit. No model data leaves the machine, making it suitable for private or air-gapped workflows.

Base URL

The server binds to loopback only and restricts browser access to local Allternit development and production origins.

Installation

Run the installer, then start the companion:
Installation data lives under ~/Library/Application Support/Allternit/local-models and can be removed without touching user documents.

Requirements

  • Apple Silicon Mac
  • Python 3.13 (managed by uv)
  • uv
  • At least 8 GiB of free storage
Full Xcode is not required. The installer uses a pinned, auditable upstream model runtime package and the official prebuilt MLX wheel.

Endpoints

JSON examples

Generate an image

Response:

Health check

Response:

Configuration

The companion is configured through environment variables and the installer scripts. No external API keys are required.

Error codes