llmfit
A command line tool that checks your CPU, RAM and GPU and recommends which open-source language models your machine can run comfortably.
Pick a small issue you can reproduce, then fix it with your AI coding agent.
Share on XLicense: MIT
Overview
llmfit is a command line tool written in Rust that checks your hardware and recommends which open-source language models it can run comfortably. It inspects CPU cores, system RAM, GPUs, VRAM and accelerator setup, then suggests models across common quantizations. It also has a terminal interface where you can measure real speed and submit results back to the project.
Key features
- Detects CPU, RAM, GPU, VRAM and unified memory
- Recognizes NVIDIA CUDA, Apple Silicon, AMD ROCm and Intel OneAPI
- Recommends models across popular quantizations
- Benchmarks real tokens per second from the terminal interface
- Your own measurements replace estimates in the fit table
Best for
Anyone choosing a local LLM who wants to know what fits their machine before downloading. Without a benchmark, the figures are estimates.
- Upstream
- AlexsJones/llmfit
- Fork on GitHub
- Guo-astro/llmfit
- Upstream stars
- 38k
- Category
- AI agents and LLM tools
- License
- MIT
- Forked
- 2026-02-22
- Sync status
- Diverged from upstream
More in AI agents and LLM tools
A collection of AI research skills and guides that helps researchers with idea evaluation, literature research, paper writing, and pre-submission review.
Forked 2026-10-18Last synced 2026-10-19Custom license (see repository)AI agents and LLM toolsGitHub
RLVE supports language model reinforcement learning with adaptive, verifiable environments for generating problems and evaluating model outputs.
Forked 2026-10-17Last synced 2026-10-19License: MITAI agents and LLM toolsGitHub
Provides modular Android development instructions for AI agents, helping them follow specialized workflows. Install individual skills or the full set with Android CLI.
Forked 2026-10-16Last synced 2026-10-19License: Apache-2.0AI agents and LLM toolsGitHub
Pi Agent is a local desktop app for using the Pi AI coding agent on macOS, Windows, and Linux. It helps you manage coding sessions, work with project files, and run saved prompts without setting up a terminal environment.
Forked 2026-10-15Last synced 2026-10-19License: MITAI agents and LLM toolsGitHub