Forward-Backward Reasoning in Large Language Models for Mathematical Verification

A learning algorithm for Boltzmann machines

David H Ackley, Geoffrey E Hinton, and Terrence J Sejnowski. 1985 · 1985

Earlier work this paper cites.

The backward induction paradox

Philip Pettit and Robert Sugden. 1989 · 1989

Earlier work this paper cites.

Artificial Intelligence: A Modern Approach

Staurt J Russell and Peter Norvig. 1995 · 1995

Earlier work this paper cites.

Learning to solve arithmetic word problems with verb categorization

Mohammad Javad Hosseini, Hannaneh Hajishirzi, Oren Etzioni, and Nate Kushman. 2014 · 2014

Earlier work this paper cites.

Parsing algebraic word problems into equations

Rik Koncel-Kedziorski, Hannaneh Hajishirzi, Ashish Sabharwal, Oren Etzioni, and Siena Dumas Ang. 2015 · 2015

Earlier work this paper cites.

Solving general arithmetic word problems

Subhro Roy and Dan Roth. 2015 · 2015

Earlier work this paper cites.

Learning knowledge base inference with neural theorem provers

Tim Rocktäschel and Sebastian Riedel. 2016 · 2016

Earlier work this paper cites.

Controlling linguistic style aspects in neural language generation

Jessica Ficler and Yoav Goldberg. 2017 · 2017

Earlier work this paper cites.

Program induction by rationale generation: Learning to solve and explain algebraic word problems

Wang Ling, Dani Yogatama, Chris Dyer, and Phil Blunsom. 2017 · 2017

Earlier work this paper cites.

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 2020

Earlier work this paper cites.

Learning to prove theorems by learning to generate theorems

Mingzhe Wang and Jia Deng. 2020 · 2020

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Hesse Christopher, and Schulman John. 2021 · 2021

Earlier work this paper cites.

Text modular networks: Learning to decompose tasks in the language of existing models

Tushar Khot, Daniel Khashabi, Kyle Richardson, Peter Clark, and Ashish Sabharwal. 2021 · 2021

Earlier work this paper cites.

Explainable multi-hop verbal reasoning through internal monologue

Zhengzhong Liang, Steven Bethard, and Mihai Surdeanu. 2021 · 2021

Earlier work this paper cites.

Are NLP models really able to solve simple math word problems?

Arkil Patel, Satwik Bhattamishra, and Navin Goyal. 2021 · 2021

Earlier work this paper cites.

Meta-learning via language model in-context tuning

Yanda Chen, Ruiqi Zhong, Sheng Zha, George Karypis, and He He. 2022 · 2022

Earlier work this paper cites.

PaLM: Scaling language modeling with pathways

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, and Noah Fiedel. 2022 · 2022

Earlier work this paper cites.

Large language models are zero-shot reasoners

Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022 · 2022

Cited alongside, same era.

Dynamic prompt learning via policy gradient for semi-structured mathematical reasoning

Pan Lu, Liang Qiu, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Tanmay Rajpurohit, Peter Clark, and Ashwin Kalyan. 2022 · 2022

Cited alongside, same era.

MetaICL: Learning to learn in context

Sewon Min, Mike Lewis, Luke Zettlemoyer, and Hannaneh Hajishirzi. 2022 · 2022

Cited alongside, same era.

Chain of thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed H. Chi, Quoc V Le, and Denny Zhou. 2022 · 2022

Cited alongside, same era.

Teaching large language models to Self-Debug

Original

Xinyun Chen, Maxwell Lin, Nathanael Schärli, and Denny Zhou. 2023 · 2023

Cited alongside, same era.

Peano: learning formal mathematical reasoning

Gabriel Poesia and Noah D Goodman. 2023 · 2023

Closest in time.

Synthetic prompting: Generating chain-of-thought demonstrations for large language models

Zhihong Shao, Yeyun Gong, Yelong Shen, Minlie Huang, Nan Duan, and Weizhu Chen. 2023 · 2023

Closest in time.

Reflexion: Language agents with verbal reinforcement learning

Noah Shinn, Federico Cassano, Beck Labash, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. 2023 · 2023

Closest in time.

Self-Consistency improves chain of thought reasoning in language models

Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V Le, Ed H. Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2023 · 2023

Closest in time.

Generating sequences by learning to Self-Correct

Sean Welleck, Ximing Lu, Peter West, Faeze Brahman, Tianxiao Shen, Daniel Khashabi, and Yejin Choi. 2023 · 2023

Closest in time.

Large language models are better reasoners with Self-Verification