Improving Physics Reasoning in Large Language Models Using Mixture of Refinement Agents

Language models are few-shot learners

Brown, T.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J. D.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; et al. 2020 · 1901

Earlier work this paper cites.

KILT: a benchmark for knowledge intensive language tasks

Original

Petroni, F.; Piktus, A.; Fan, A.; Lewis, P.; Yazdani, M.; De Cao, N.; Thorne, J.; Jernite, Y.; Karpukhin, V.; Maillard, J.; et al. 2020 · 2009

Earlier work this paper cites.

Retrieval-augmented generation for knowledge-intensive nlp tasks

Lewis, P.; Perez, E.; Piktus, A.; Petroni, F.; Karpukhin, V.; Goyal, N.; Küttler, H.; Lewis, M.; Yih, W.-t.; Rocktäschel, T.; et al. 2020 · 2020

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Cobbe, K.; Kosaraju, V.; Bavarian, M.; Chen, M.; Jun, H.; Kaiser, L.; Plappert, M.; Tworek, J.; Hilton, J.; Nakano, R.; et al. 2021 · 2021

Earlier work this paper cites.

Measuring mathematical problem solving with the math dataset

Original

Hendrycks, D.; Burns, C.; Kadavath, S.; Arora, A.; Basart, S.; Tang, E.; Song, D.; and Steinhardt, J. 2021 · 2021

Earlier work this paper cites.

Program of thoughts prompting: Disentangling computation from reasoning for numerical reasoning tasks

Original

Chen, W.; Ma, X.; Wang, X.; and Cohen, W. W. 2022 · 2022

Earlier work this paper cites.

Complexity-based prompting for multi-step reasoning

Fu, Y.; Peng, H.; Sabharwal, A.; Clark, P.; and Khot, T. 2022 · 2022

Earlier work this paper cites.

Learn to explain: Multimodal reasoning via thought chains for science question answering

Lu, P.; Mishra, S.; Xia, T.; Qiu, L.; Chang, K.-W.; Zhu, S.-C.; Tafjord, O.; Clark, P.; and Kalyan, A. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Wei, J.; Wang, X.; Schuurmans, D.; Bosma, M.; Xia, F.; Chi, E.; Le, Q. V.; Zhou, D.; et al. 2022 · 2022

Earlier work this paper cites.

Automatic chain of thought prompting in large language models

Original

Zhang, Z.; Zhang, A.; Li, M.; and Smola, A. 2022 · 2022

Earlier work this paper cites.

Have llms advanced enough? a challenging problem solving benchmark for large language models

Original

Arora, D.; Singh, H. G.; et al. 2023 · 2023

Earlier work this paper cites.

Generative ai for math: Abel

Chern, E.; Zou, H.; Li, X.; Hu, J.; Feng, K.; Li, J.; and Liu, P. 2023 · 2023

Cited alongside, same era.

Pal: Program-aided language models

Gao, L.; Madaan, A.; Zhou, S.; Alon, U.; Liu, P.; Yang, Y.; Callan, J.; and Neubig, G. 2023 · 2023

Cited alongside, same era.

Wizardmath: Empowering mathematical reasoning for large language models via reinforced evol-instruct

Original

Luo, H.; Sun, Q.; Xu, C.; Zhao, P.; Lou, J.; Tao, C.; Geng, X.; Lin, Q.; Chen, S.; and Zhang, D. 2023 · 2023

Cited alongside, same era.

Selfcheck: Using llms to zero-shot check their own step-by-step reasoning

Original

Miao, N.; Teh, Y. W.; and Rainforth, T. 2023 · 2023

Cited alongside, same era.

Rethinking language models as symbolic knowledge graphs

Original

Mruthyunjaya, V.; Pezeshkpour, P.; Hruschka, E.; and Bhutani, N. 2023 · 2023

Cited alongside, same era.

GeoVQA: A Comprehensive Multimodal Geometry Dataset for Secondary Education

Anand, A.; Jaiswal, R.; Dharmadhikari, A.; Marathe, A.; Popat, H.; Mital, H.; Nair, A. R.; Prasad, K.; Kumar, S.; Verma, A.; et al. 2024b · 2024

Closest in time.

From local to global: A graph rag approach to query-focused summarization

Original

Edge, D.; Trinh, H.; Cheng, N.; Bradley, J.; Chao, A.; Mody, A.; Truitt, S.; and Larson, J. 2024 · 2024

Closest in time.

Olympiadbench: A challenging benchmark for promoting agi with olympiad-level bilingual multimodal scientific problems

Original

He, C.; Luo, R.; Bai, Y.; Hu, S.; Thai, Z. L.; Shen, J.; Hu, J.; Han, X.; Huang, Y.; Zhang, Y.; et al. 2024 · 2024

Closest in time.

Evaluating Mathematical Reasoning of Large Language Models: A Focus on Error Identification and Correction

Original

Li, X.; Wang, W.; Li, M.; Guo, J.; Zhang, Y.; and Feng, F. 2024 · 2024

Closest in time.

Deductive verification of chain-of-thought reasoning