exo
exo connects multiple devices into a local AI cluster, so you can run models too large for one device. Use its dashboard or compatible APIs to interact with models.
Pick a small issue you can reproduce, then fix it with your AI coding agent.
Share on XLicense: Apache-2.0
Overview
exo is software for connecting devices into a local AI cluster, helping run models that are too large for a single device. It automatically discovers other exo devices and chooses how to distribute a model based on the available hardware and network connections. Manage the cluster and chat with models in the built-in dashboard, or connect existing clients through compatible OpenAI, Claude, and Ollama APIs. It also supports custom models from HuggingFace.
Key features
- Automatically discovers other devices running exo.
- Distributes models across devices using hardware and network topology information.
- Includes a dashboard for managing the cluster and chatting with models.
- Supports OpenAI, Claude, and Ollama-compatible APIs, plus custom HuggingFace models.
Best for
People with multiple compatible devices who want to run AI models locally across them. It is useful when a model exceeds one device's capacity or when existing API clients should connect to the cluster.
- Upstream
- exo-explore/exo
- Fork on GitHub
- Guo-astro/exo
- Upstream stars
- 48k
- Category
- AI agents and LLM tools
- Language
- Python
- License
- Apache-2.0
- Forked
- 2026-10-11
- Sync status
- In syncLast synced 2026-11-08
More in AI agents and LLM tools
/last30days is an AI-agent skill for researching recent discussions across social platforms, video, news, markets, and the web. It brings scattered signals together in a synthesized brief for trend research and preparation.
Forked 2026-10-22Last synced 2026-11-08License: MITAI agents and LLM toolsGitHub
A portable C99 inference engine for running Kimi K3 on a CPU without a GPU or machine-learning framework. It streams the large checkpoint from disk to support inference with limited RAM, for batch text generation or text chat.
Forked 2026-10-21Last synced 2026-11-08License: Apache-2.0AI agents and LLM toolsGitHub
LayerFS gives AI agents writable workspaces over shared history, so they can work in parallel without copying the base. Use it to checkpoint, branch, rewind, and merge agent changes.
Forked 2026-10-21Last synced 2026-11-08License: MITAI agents and LLM toolsGitHub
Magnitude runs open models locally and tunes kernels for your hardware. Use it to connect local models to supported agents or an OpenAI-compatible client.
Forked 2026-10-19Last synced 2026-11-08License: Apache-2.0AI agents and LLM toolsGitHub