llmfit
A command line tool that checks your CPU, RAM and GPU and recommends which open-source language models your machine can run comfortably.
Pick a small issue you can reproduce, then fix it with your AI coding agent.
Share on XLicense: MIT
Overview
llmfit is a command line tool written in Rust that checks your hardware and recommends which open-source language models it can run comfortably. It inspects CPU cores, system RAM, GPUs, VRAM and accelerator setup, then suggests models across common quantizations. It also has a terminal interface where you can measure real speed and submit results back to the project.
Key features
- Detects CPU, RAM, GPU, VRAM and unified memory
- Recognizes NVIDIA CUDA, Apple Silicon, AMD ROCm and Intel OneAPI
- Recommends models across popular quantizations
- Benchmarks real tokens per second from the terminal interface
- Your own measurements replace estimates in the fit table
Best for
Anyone choosing a local LLM who wants to know what fits their machine before downloading. Without a benchmark, the figures are estimates.
- Upstream
- AlexsJones/llmfit
- Fork on GitHub
- Guo-astro/llmfit
- Upstream stars
- 39k
- Category
- AI agents and LLM tools
- License
- MIT
- Forked
- 2026-02-22
- Sync status
- Diverged from upstream
More in AI agents and LLM tools
/last30days is an AI-agent skill for researching recent discussions across social platforms, video, news, markets, and the web. It brings scattered signals together in a synthesized brief for trend research and preparation.
Forked 2026-10-22Last synced 2026-11-09License: MITAI agents and LLM toolsGitHub
A portable C99 inference engine for running Kimi K3 on a CPU without a GPU or machine-learning framework. It streams the large checkpoint from disk to support inference with limited RAM, for batch text generation or text chat.
Forked 2026-10-21Last synced 2026-11-09License: Apache-2.0AI agents and LLM toolsGitHub
LayerFS gives AI agents writable workspaces over shared history, so they can work in parallel without copying the base. Use it to checkpoint, branch, rewind, and merge agent changes.
Forked 2026-10-21Last synced 2026-11-09License: MITAI agents and LLM toolsGitHub
Magnitude runs open models locally and tunes kernels for your hardware. Use it to connect local models to supported agents or an OpenAI-compatible client.
Forked 2026-10-19Last synced 2026-11-09License: Apache-2.0AI agents and LLM toolsGitHub