LegalBench

A collaboratively built benchmark for measuring the legal reasoning abilities of large language models.

1 articleLast mentioned

LegalBench is a benchmark designed to evaluate the legal reasoning abilities of large language models. It was built collaboratively by legal experts and researchers, led by Neel Guha of Stanford University, and released in 2023. It consists of more than 160 tasks covering several types of legal reasoning, including issue spotting, rule recall, rule application, rule conclusion, and interpretation.

The tasks are organized around a taxonomy of reasoning types used in legal practice and scholarship. The benchmark is widely used to compare model performance in the legal domain and to measure the effect of changes to models or prompts.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Prompt Audits and Cache Reuse Cut Claude Costs Up to 72.9%, Anthropic SaysAI in Practice ·

    LegalBench -66.9% -0.8 points

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.