harvey-labs
An open-source benchmark that measures how well AI agents handle realistic legal work. It provides tasks and evaluation for improving legal agents.
Share on XLicense: MIT
Overview
Harvey LAB, short for Legal Agent Benchmark, is an open-source project from Harvey AI for measuring how well LLM agents handle realistic legal work. It has two parts: a dataset of tasks with instructions, documents and rubrics, and an execution harness that runs agents on those tasks and scores them. A tutorial walks through one M&A data-room assignment from setup to comparison dashboards.
Key features
- Task dataset with instructions, documents and rubrics
- Execution harness for running and evaluating agents
- All-pass rubric scoring with an LLM judge
- Reports and comparison dashboards
- Adapters for adding models and tasks
Best for
Researchers and teams building or comparing AI agents for legal work who need a shared test set. The README says the task set and harness are still being extended.
- Upstream
- harveyai/harvey-labs
- Fork on GitHub
- Guo-astro/harvey-labs
- Upstream stars
- 1.4k
- Category
- AI agents and LLM tools
- Language
- Python
- License
- MIT
- Forked
- 2026-09-28
- Sync status
- In syncLast synced 2026-10-14
More in AI agents and LLM tools
Deltafin runs the full, unpruned Kimi K3 locally and provides an OpenAI-compatible API for chat and coding agents. It explores local inference on consumer hardware without reducing model quality.
Forked 2026-10-13Last synced 2026-10-14Custom license (see repository)AI agents and LLM toolsGitHub
A survey and paper list for studying large language model based agents, organizing research on agent frameworks, applications, agent societies, and open problems.
Forked 2026-10-12Last synced 2026-10-14No license declaredAI agents and LLM toolsGitHub
Skales is a personal AI agent for desktop and mobile that works with files and apps on your computer. Use it to assign multi-step goals, automate tasks, or get coding help.
Forked 2026-10-12Last synced 2026-10-14Custom license (see repository)AI agents and LLM toolsGitHub
YuE2 turns lyrics and a style prompt into an editable song plan and finished music with vocals and accompaniment. It also supports style-based covers and conversational music editing.
Forked 2026-10-12Last synced 2026-10-14License: Apache-2.0AI agents and LLM toolsGitHub