PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Models

Tree-to-tree correction for document trees: Technical report 95-372

David T. Barnard, Gwen Clarke, and Nicholas Duncan · 1995

Earlier work this paper cites.

Sympy: symbolic computing in python

Aaron Meurer, Christopher P. Smith, Mateusz Paprocki, Ondřej Čertík, Sergey B. Kirpichev, Matthew Rocklin, AMiT Kumar, Sergiu Ivanov, Jason K. Moore, Sartaj Singh, Thilina Rathnayake, Sean Vig, Brian E. Granger, Richard P. Muller, Francesco Bonazzi, Harsh Gupta, Shivam Vats, Fredrik Johansson, Fabian Pedregosa, Matthew J. Curry, Andy R. Terrel, Štěpán Roučka, Ashutosh Saboo, Isuru Fernando, Sumith Kulal, Robert Cimrman, and Anthony Scopatz · 2017

Earlier work this paper cites.

Training verifiers to solve math word problems, 2021

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman · 2021

Earlier work this paper cites.

Self-consistency improves chain of thought reasoning in language models, 2023

Original

Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou · 2023

Earlier work this paper cites.

Tree of thoughts: Deliberate problem solving with large language models

Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Tom Griffiths, Yuan Cao, and Karthik Narasimhan · 2023

Earlier work this paper cites.

Deepseek-v3 technical report, 2024

Original

DeepSeek-AI · 2024

Earlier work this paper cites.

OlympiadBench: A challenging benchmark for promoting AGI with olympiad-level bilingual multimodal scientific problems

Chaoqun He, Renjie Luo, Yuzhuo Bai, Shengding Hu, Zhen Thai, Junhao Shen, Jinyi Hu, Xu Han, Yujie Huang, Yuxiang Zhang, Jie Liu, Lei Qi, Zhiyuan Liu, and Maosong Sun · 2024

Earlier work this paper cites.

Let’s verify step by step

Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe · 2024

Cited alongside, same era.

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Machel et al Reid · 2024

Cited alongside, same era.

GPQA: A graduate-level google-proof q&a benchmark

David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R. Bowman · 2024

Cited alongside, same era.

Gemini: A family of highly capable multimodal models, 2024

Original

Gemini Team · 2024

Cited alongside, same era.

Matharena: Evaluating llms on uncontaminated math competitions, February 2025

Mislav Balunović, Jasper Dekoninck, Ivo Petrov, Nikola Jovanović, and Martin Vechev · 2025

Cited alongside, same era.

Supergpqa: Scaling llm evaluation across 285 graduate disciplines, 2025

Original

P Team et al · 2025

Closest in time.

Humanity’s Last Exam

Phan et al · 2025

Closest in time.

Grok 3 beta — the age of reasoning agents

grok · 2025

Closest in time.

Aime 2024 dataset

Hugging Face H4 · 2025

Closest in time.

Latex2sympy_extended package

hynky1999 · 2025

Closest in time.

s1: Simple test-time scaling

Original

Niklas Muennighoff, Zitong Yang, Weijia Shi, Xiang Lisa Li, Li Fei-Fei, Hannaneh Hajishirzi, Luke Zettlemoyer, Percy Liang, Emmanuel Candès, and Tatsunori Hashimoto · 2025

Closest in time.