magnitude
Magnitude runs open models locally and tunes kernels for your hardware. Use it to connect local models to supported agents or an OpenAI-compatible client.
Pick a small issue you can reproduce, then fix it with your AI coding agent.
Share on XLicense: Apache-2.0
Overview
Magnitude is an open-source inference engine and desktop app for running open models locally. It tunes kernels for each model on the user's hardware when the model is downloaded, aiming to improve speed without changing model output. Users can discover and download models, then connect supported agents with one click or use the OpenAI-compatible API. It supports Apple Silicon, NVIDIA and AMD GPUs, and CPU-only systems on macOS, Linux, and Windows. Prompts and models stay on the user's machine.
Key features
- Tunes model kernels on the user's hardware during download.
- Provides a desktop app with model discovery and downloads.
- Connects supported agents with one click and offers an OpenAI-compatible API.
- Runs on Apple Silicon, NVIDIA and AMD GPUs, or CPU-only systems across macOS, Linux, and Windows.
- Keeps prompts and models on the user's machine.
Best for
People who want to run open models locally and connect them to an agent they already use. It also suits users who want the inference engine to tune kernels for their hardware.
- Upstream
- magnitudedev/magnitude
- Fork on GitHub
- Guo-astro/magnitude
- Upstream stars
- 7.7k
- Category
- AI agents and LLM tools
- Language
- Rust
- License
- Apache-2.0
- Forked
- 2026-10-19
- Sync status
- Updated by last syncLast synced 2026-11-09
More in AI agents and LLM tools
/last30days is an AI-agent skill for researching recent discussions across social platforms, video, news, markets, and the web. It brings scattered signals together in a synthesized brief for trend research and preparation.
Forked 2026-10-22Last synced 2026-11-09License: MITAI agents and LLM toolsGitHub
A portable C99 inference engine for running Kimi K3 on a CPU without a GPU or machine-learning framework. It streams the large checkpoint from disk to support inference with limited RAM, for batch text generation or text chat.
Forked 2026-10-21Last synced 2026-11-09License: Apache-2.0AI agents and LLM toolsGitHub
LayerFS gives AI agents writable workspaces over shared history, so they can work in parallel without copying the base. Use it to checkpoint, branch, rewind, and merge agent changes.
Forked 2026-10-21Last synced 2026-11-09License: MITAI agents and LLM toolsGitHub
A collection of AI research skills and guides that helps researchers with idea evaluation, literature research, paper writing, and pre-submission review.
Forked 2026-10-18Last synced 2026-11-09Custom license (see repository)AI agents and LLM toolsGitHub