ARC-AGI
ARC-AGI is a benchmark run by ARC Prize that evaluates AI's abstract reasoning and ability to adapt to unfamiliar problems.
ARC-AGI (Abstraction and Reasoning Corpus for Artificial General Intelligence) is a benchmark proposed by AI researcher François Chollet in 2019. It measures how well AI adapts to unfamiliar problems using tasks that are easy for people but hard for AI. The nonprofit ARC Prize runs the benchmark and has released new versions.
Earlier versions asked systems to infer rules from input and output examples of grid puzzles. The third version, ARC-AGI-3, places an AI in interactive game environments without instructions, where it must explore and work out the goals and rules, and it also compares the AI's efficiency with that of human players.
This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.