FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI

Understand

We introduce FrontierMath, a benchmark of hundreds of original, exceptionally challenging mathematics problems crafted and vetted by expert mathematicians.

• The questions cover most major branches of modern mathematics -- from computationally intensive problems in number theory and real analysis to abstract questions in algebraic geometry and category theory.
• Solving a typical problem requires multiple hours of effort from a researcher in the relevant branch of mathematics, and for the upper end questions, multiple days.
• FrontierMath uses new, unpublished problems and automated verification to reliably evaluate models while minimizing risk of data contamination.