rcli
A command line tool for running open models such as DeepSeek and Gemma on your own machine or hosted. You can chat, serve a model as an API, or open a coding agent on it.
Pick a small issue you can reproduce, then fix it with your AI coding agent.
Share on XLicense: MIT
Overview
Wally, from RunAnywhereAI, is a command line tool for running open models such as DeepSeek, Gemma and Qwen on your own machine, or hosted when a job outgrows it. One command lets you chat with a model, serve it as an OpenAI-compatible API, or open a coding agent on it. Local use needs no account or key.
Key features
- Chat with a model using wally run
- Serve an OpenAI-compatible API with wally serve
- Pull models by name or any Hugging Face GGUF path
- Open supported coding agents on a local model
- Hosted models bill against RunAnywhere credit
Best for
People who want to try open models locally from a terminal. It supports Apple Silicon Macs, x86-64 Linux with glibc 2.35 or newer, and Windows, but not Intel Macs.
- Upstream
- RunanywhereAI/wally
- Fork on GitHub
- Guo-astro/rcli
- Upstream stars
- 1.6k
- Category
- AI agents and LLM tools
- Language
- Rust
- License
- MIT
- Forked
- 2026-03-08
- Sync status
- In syncLast synced 2026-11-08
More in AI agents and LLM tools
/last30days is an AI-agent skill for researching recent discussions across social platforms, video, news, markets, and the web. It brings scattered signals together in a synthesized brief for trend research and preparation.
Forked 2026-10-22Last synced 2026-11-08License: MITAI agents and LLM toolsGitHub
A portable C99 inference engine for running Kimi K3 on a CPU without a GPU or machine-learning framework. It streams the large checkpoint from disk to support inference with limited RAM, for batch text generation or text chat.
Forked 2026-10-21Last synced 2026-11-08License: Apache-2.0AI agents and LLM toolsGitHub
LayerFS gives AI agents writable workspaces over shared history, so they can work in parallel without copying the base. Use it to checkpoint, branch, rewind, and merge agent changes.
Forked 2026-10-21Last synced 2026-11-08License: MITAI agents and LLM toolsGitHub
Magnitude runs open models locally and tunes kernels for your hardware. Use it to connect local models to supported agents or an OpenAI-compatible client.
Forked 2026-10-19Last synced 2026-11-08License: Apache-2.0AI agents and LLM toolsGitHub