Remote Labor Index

Remote Labor Index is a benchmark released in 2025 by the Center for AI Safety and Scale AI that measures how well AI agents complete real freelance remote work projects.

1 articleLast mentioned

The Remote Labor Index (RLI) is a benchmark that measures how well AI agents can complete real freelance work that humans normally perform remotely. It was released in 2025 by the Center for AI Safety (CAIS) and Scale AI. Its tasks are drawn from projects actually posted on freelance platforms across fields such as graphic design, video editing, data analysis, software development and writing, and human experts judge whether the deliverables meet the client's requirements.

The primary metric is the automation rate, the share of projects an agent completes to a professional standard. Unlike benchmarks built around coding puzzles or multiple-choice exams, RLI evaluates multi-step, end-to-end work by its final deliverables, and it is used as an indicator of how much remote labor AI systems can currently take on.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Claude Fable 5.2 Benchmarks and Five Real Tasks: Where the Gains Show UpAI Performance ·

    …74.2 percent on Humanity's Last Exam with tools, 73.4 percent on the Chartography chart-reading test, and 41.3 percent on the Remote Labor Index at high effort.

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.