The Bradley-Terry model is a statistical model that estimates the relative strength of items from the outcomes of pairwise comparisons. Proposed by Ralph A. Bradley and Milton E. Terry in 1952, it expresses the probability that item i is preferred over item j as a ratio of the two items' strength parameters, which are typically fitted by maximum likelihood from observed comparisons.
In AI, it is widely used as the basis of the loss function for training reward models on human preference data. Preference learning in RLHF (reinforcement learning from human feedback), where the model is trained to assign a higher score to the response a human chose, is the canonical example. It is also used to rank models on evaluation platforms such as Chatbot Arena, where users vote between the outputs of two models.
Outside AI, the model has long been used in statistics and sports to rank players or teams from match results.