LADDER: Self-Improving LLMs Through Recursive Problem Decomposition

Curriculum learning for reinforcement learning domains: A framework and survey, 2020

Sanmit Narvekar, Bei Peng, Matteo Leonetti, Jivko Sinapov, Matthew E. Taylor, and Peter Stone · 2020

Earlier work this paper cites.

On reinforcement learning and distribution matching for fine-tuning language models with no catastrophic forgetting, 2022

Tomasz Korbak, Hady Elsahar, Germán Kruszewski, and Marc Dymetman · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback, 2022

Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe · 2022

Earlier work this paper cites.

Language models can teach themselves to program better, 2023

Patrick Haluptzok, Matthew Bowers, and Adam Tauman Kalai · 2023

Earlier work this paper cites.

Let’s verify step by step, 2023

Hunter Lightman, Vineet Kosaraju, Yura Burda, Harri Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe · 2023

Earlier work this paper cites.

Self-consistency improves chain of thought reasoning in language models, 2023

Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou · 2023

Cited alongside, same era.

Tree of thoughts: Deliberate problem solving with large language models, 2023

Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, and Karthik Narasimhan · 2023

Cited alongside, same era.

Learning to reason with llms, 2024

OpenAI · 2024

Cited alongside, same era.

Deepseekmath: Pushing the limits of mathematical reasoning in open language models, 2024

Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Xiao Bi, Haowei Zhang, Mingchuan Zhang, Y. K. Li, Y. Wu, and Daya Guo · 2024

Cited alongside, same era.

Sft memorizes, rl generalizes: A comparative study of foundation model post-training, 2025

Tianzhe Chu, Yuexiang Zhai, Jihan Yang, Shengbang Tong, Saining Xie, Dale Schuurmans, Quoc V. Le, Sergey Levine, and Yi Ma · 2025

Cited alongside, same era.

Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning, 2025

DeepSeek-AI · 2025

Closest in time.

Tulu 3: Pushing frontiers in open language model post-training, 2025

Nathan Lambert, Jacob Morrison, Valentina Pyatkin, Shengyi Huang, Hamish Ivison, Faeze Brahman, Lester James V. Miranda, Alisa Liu, Nouha Dziri, Shane Lyu, Yuling Gu, Saumya Malik, Victoria Graf, Jena D. Hwang, Jiangjiang Yang, Ronan Le Bras, Oyvind Tafjord, Chris Wilhelm, Luca Soldaini, Noah A. Smith, Yizhong Wang, Pradeep Dasigi, and Hannaneh Hajishirzi · 2025

Closest in time.

s1: Simple test-time scaling, 2025

Niklas Muennighoff, Zitong Yang, Weijia Shi, Xiang Lisa Li, Li Fei-Fei, Hannaneh Hajishirzi, Luke Zettlemoyer, Percy Liang, Emmanuel Candès, and Tatsunori Hashimoto · 2025

Closest in time.

Logic-rl: Unleashing llm reasoning with rule-based reinforcement learning, 2025

Tian Xie, Zitian Gao, Qingnan Ren, Haoming Luo, Yuqian Hong, Bryan Dai, Joey Zhou, Kai Qiu, Zhirong Wu, and Chong Luo · 2025

Closest in time.

Star: Bootstrapping reasoning with reasoning, 2022

Eric Zelikman, Yuhuai Wu, Jesse Mu, and Noah D. Goodman · 2025

Closest in time.