HARDMath: A Benchmark Dataset for Challenging Problems in Applied Mathematics

Dimensional analysis and the buckingham pi theorem

John H Evans · 1972

Earlier work this paper cites.

Advanced mathematical methods for scientists and engineers I: Asymptotic methods and perturbation theory

Carl M Bender and Steven A Orszag · 2013

Earlier work this paper cites.

Galois Theory

Ian Stewart · 2015

Earlier work this paper cites.

Sympy: symbolic computing in python

Aaron Meurer, Christopher P. Smith, Mateusz Paprocki, Ondřej Čertík, Sergey B. Kirpichev, Matthew Rocklin, AMiT Kumar, Sergiu Ivanov, Jason K. Moore, Sartaj Singh, Thilina Rathnayake, Sean Vig, Brian E. Granger, Richard P. Muller, Francesco Bonazzi, Harsh Gupta, Shivam Vats, Fredrik Johansson, Fabian Pedregosa, Matthew J. Curry, Andy R. Terrel, Štěpán Roučka, Ashutosh Saboo, Isuru Fernando, Sumith Kulal, Robert Cimrman, and Anthony Scopatz · 2017

Earlier work this paper cites.

Improving language understanding by generative pre-training

Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever · 2018

Earlier work this paper cites.

Mathqa: Towards interpretable math word problem solving with operation-based formalisms

Aida Amini, Saadia Gabriel, Shanchuan Lin, Rik Koncel-Kedziorski, Yejin Choi, and Hannaneh Hajishirzi · 2019

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever · 2019

Earlier work this paper cites.

Scipy 1.0: fundamental algorithms for scientific computing in python

Pauli Virtanen, Ralf Gommers, Travis E Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, et al · 2020

Earlier work this paper cites.

Measuring mathematical problem solving with the math dataset

Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt · 2021

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman · 2021

Cited alongside, same era.

Training language models to follow instructions with human feedback, 2022

Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe · 2022

Cited alongside, same era.

Have llms advanced enough? a challenging problem solving benchmark for large language models

Daman Arora, Himanshu Singh, et al · 2023

Cited alongside, same era.

Arb: Advanced reasoning benchmark for large language models

Original

Tomohiro Sawada, Daniel Paleka, Alexander Havrilla, Pranav Tadepalli, Paula Vidas, Alexander Kranias, John J Nay, Kshitij Gupta, and Aran Komatsuzaki · 2023

Cited alongside, same era.

Mathematical capabilities of chatgpt

Simon Frieder, Luca Pinchetti, Ryan-Rhys Griffiths, Tommaso Salvatori, Thomas Lukasiewicz, Philipp Petersen, and Julius Berner · 2024

Closest in time.

Submit your toughest questions for humanity’s last exam, 2024

Dan Hendrycks and Alexandr Wang · 2024

Closest in time.

Introducing openai o1-preview, 2024

OpenAI · 2024

Closest in time.

Openai o1-mini, 2024a

OpenAI · 2024

Closest in time.

Meta llama 3, 2024

Meta AI · 2024

Closest in time.

Code llama: Ai for coding, 2023

Meta · 2024

Closest in time.

Reasoning models, 2024b

OpenAI · 2024

Closest in time.