deltafin
Deltafin runs the full, unpruned Kimi K3 locally and provides an OpenAI-compatible API for chat and coding agents. It explores local inference on consumer hardware without reducing model quality.
Share on XCustom license (see repository)
Overview
Deltafin is a Rust project packaged as a native binary for running the complete, unpruned 2.8-trillion-parameter Kimi K3 model on a single device. It explores local inference for a model intended for large-scale infrastructure while keeping all 16 experts and leaving token decisions to K3. Optional small draft models can propose tokens, which K3 verifies. The project also provides an OpenAI-compatible API server for local chat and coding agents, with support listed for macOS ARM64 and Linux x86-64/aarch64 using Metal/MPS, CUDA, or CPU.
Key features
- Runs the full, unpruned Kimi K3 model with all 16 experts.
- Lets optional small draft models suggest tokens, then has K3 verify them.
- Provides an OpenAI-compatible API server for local chat and coding agents.
- Lists macOS ARM64 and Linux support with Metal/MPS, CUDA, or CPU.
Best for
Researchers and enthusiasts exploring how to run a very large model locally without pruning it. It also suits people who want an OpenAI-compatible local API for chat or coding agents.
- Upstream
- gavamedia/deltafin
- Fork on GitHub
- Guo-astro/deltafin
- Upstream stars
- 847
- Category
- AI agents and LLM tools
- Language
- Rust
- License
- Custom license (see repository)
- Forked
- 2026-10-13
- Sync status
- In syncLast synced 2026-10-14
More in AI agents and LLM tools
A survey and paper list for studying large language model based agents, organizing research on agent frameworks, applications, agent societies, and open problems.
Forked 2026-10-12Last synced 2026-10-14No license declaredAI agents and LLM toolsGitHub
Skales is a personal AI agent for desktop and mobile that works with files and apps on your computer. Use it to assign multi-step goals, automate tasks, or get coding help.
Forked 2026-10-12Last synced 2026-10-14Custom license (see repository)AI agents and LLM toolsGitHub
YuE2 turns lyrics and a style prompt into an editable song plan and finished music with vocals and accompaniment. It also supports style-based covers and conversational music editing.
Forked 2026-10-12Last synced 2026-10-14License: Apache-2.0AI agents and LLM toolsGitHub
DeepTutor is an AI tutoring project for organizing learning materials and turning them into interactive study and research. It helps learners study with a personal knowledge base.
Forked 2026-10-12Last synced 2026-10-14License: Apache-2.0AI agents and LLM toolsGitHub