harvey-labs
An open-source benchmark that measures how well AI agents handle realistic legal work. It provides tasks and evaluation for improving legal agents.
Share on XLicense: MIT
Overview
Harvey LAB, short for Legal Agent Benchmark, is an open-source project from Harvey AI for measuring how well LLM agents handle realistic legal work. It has two parts: a dataset of tasks with instructions, documents and rubrics, and an execution harness that runs agents on those tasks and scores them. A tutorial walks through one M&A data-room assignment from setup to comparison dashboards.
Key features
- Task dataset with instructions, documents and rubrics
- Execution harness for running and evaluating agents
- All-pass rubric scoring with an LLM judge
- Reports and comparison dashboards
- Adapters for adding models and tasks
Best for
Researchers and teams building or comparing AI agents for legal work who need a shared test set. The README says the task set and harness are still being extended.
- Upstream
- harveyai/harvey-labs
- Fork on GitHub
- Guo-astro/harvey-labs
- Upstream stars
- 1.4k
- Category
- AI agents and LLM tools
- License
- MIT
- Forked
- 2026-09-28
- Sync status
- In syncLast synced 2026-09-29
More in AI agents and LLM tools
A free desktop app where children in non-English-speaking countries practice English speaking and listening by talking with an AI companion. It can run locally and offline.
Forked 2026-09-28Last synced 2026-09-29License: MITAI agents and LLM toolsGitHub
An agent skill for Chinese patents. It helps find patentable points, write disclosure documents, explain patents in plain language, follow policy changes and assist with examination replies.
Forked 2026-09-28Last synced 2026-09-29License: MITAI agents and LLM toolsGitHub
A minimal Python library from Hugging Face for building AI agents that write and run code to solve tasks. It lets you set up capable agents in a few lines.
Forked 2026-09-28Last synced 2026-09-29License: Apache-2.0AI agents and LLM toolsGitHub
An MCP server that lets AI agents automate and scrape mobile apps on iOS and Android, across simulators, emulators and real devices.
Forked 2026-09-28Last synced 2026-09-29License: Apache-2.0AI agents and LLM toolsGitHub