llmfit
A command line tool that checks your CPU, RAM and GPU and recommends which open-source language models your machine can run comfortably.
Share on XLicense: MIT
Overview
llmfit is a command line tool written in Rust that checks your hardware and recommends which open-source language models it can run comfortably. It inspects CPU cores, system RAM, GPUs, VRAM and accelerator setup, then suggests models across common quantizations. It also has a terminal interface where you can measure real speed and submit results back to the project.
Key features
- Detects CPU, RAM, GPU, VRAM and unified memory
- Recognizes NVIDIA CUDA, Apple Silicon, AMD ROCm and Intel OneAPI
- Recommends models across popular quantizations
- Benchmarks real tokens per second from the terminal interface
- Your own measurements replace estimates in the fit table
Best for
Anyone choosing a local LLM who wants to know what fits their machine before downloading. Without a benchmark, the figures are estimates.
- Upstream
- AlexsJones/llmfit
- Fork on GitHub
- Guo-astro/llmfit
- Upstream stars
- 37k
- Category
- AI agents and LLM tools
- License
- MIT
- Forked
- 2026-02-22
- Sync status
- Diverged from upstream
More in AI agents and LLM tools
A free desktop app where children in non-English-speaking countries practice English speaking and listening by talking with an AI companion. It can run locally and offline.
Forked 2026-09-28Last synced 2026-09-29License: MITAI agents and LLM toolsGitHub
An agent skill for Chinese patents. It helps find patentable points, write disclosure documents, explain patents in plain language, follow policy changes and assist with examination replies.
Forked 2026-09-28Last synced 2026-09-29License: MITAI agents and LLM toolsGitHub
A minimal Python library from Hugging Face for building AI agents that write and run code to solve tasks. It lets you set up capable agents in a few lines.
Forked 2026-09-28Last synced 2026-09-29License: Apache-2.0AI agents and LLM toolsGitHub
An open-source benchmark that measures how well AI agents handle realistic legal work. It provides tasks and evaluation for improving legal agents.
Forked 2026-09-28Last synced 2026-09-29License: MITAI agents and LLM toolsGitHub