Elo

Elo is a rating system that updates estimates of relative skill based on head-to-head outcomes and existing ratings. It was devised by the Hungarian-American physicist Arpad Elo to rate chess players and bears his name. Unlike a score based on fixed questions, an Elo rating is relative and depends on the pool of competitors and the judging method.

In AI, pairs of model responses are compared, a preferred answer is chosen, and the outcomes are converted into Elo ratings to rank models. Leaderboards such as LMArena, formerly Chatbot Arena, are well-known examples.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.