Why LLMs Cannot Think and How to Fix It

Chain of thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed H. Chi, Quoc V Le, and Denny Zhou · 2022

Earlier work this paper cites.

Self-refine: Iterative refinement with self-feedback

Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark · 2023

Earlier work this paper cites.

Language models don’t always say what they think: Unfaithful explanations in chain-of-thought prompting

Miles Turpin, Julian Michael, Ethan Perez, and Samuel R. Bowman · 2023

Earlier work this paper cites.

Tree of thoughts: Deliberate problem solving with large language models

Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, and Karthik R Narasimhan · 2023

Earlier work this paper cites.

Think before you speak: Training language models with pause tokens

Sachin Goyal, Ziwei Ji, Ankit Singh Rawat, Aditya Krishna Menon, Sanjiv Kumar, and Vaishnavh Nagarajan · 2024

Cited alongside, same era.

Orpo: Monolithic preference optimization without reference model, 2024

Jiwoo Hong, Noah Lee, and James Thorne · 2024

Cited alongside, same era.

Large language models cannot self-correct reasoning yet

Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Wei Yu, Xinying Song, and Denny Zhou · 2024

Cited alongside, same era.

Let’s think dot by dot: Hidden computation in transformer language models, 2024

Jacob Pfau, William Merrill, and Samuel R. Bowman · 2024

Cited alongside, same era.

Llms cannot find reasoning errors, but can correct them!, 2024

Gladys Tyen, Hassan Mansoor, Victor Cărbune, Peter Chen, and Tony Mak · 2024

Later among the works it cites.

Do language models plan ahead for future tokens?, 2024

Wilson Wu, John X. Morris, and Lionel Levine · 2024

Later among the works it cites.

Quiet-star: Language models can teach themselves to think before speaking, 2024

Eric Zelikman, Georges Harik, Yijia Shao, Varuna Jayasiri, Nick Haber, and Noah D. Goodman · 2024

Later among the works it cites.