FrontierMath
FrontierMath is a benchmark from Epoch AI that tests the advanced mathematical reasoning of AI systems with original problems written by expert mathematicians.
FrontierMath is a benchmark released in 2024 by Epoch AI, a research organization that studies trends in artificial intelligence. It measures advanced mathematical reasoning with original problems written by expert mathematicians, covering many branches of modern mathematics such as number theory and algebraic geometry.
Most of the problems are kept private so that they do not leak into training data. Each problem has a definite answer, such as an exact number or mathematical object, that can be checked automatically. Because the problems are hard even for specialists, the benchmark is used to evaluate reasoning beyond the level of earlier math benchmarks.
This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.