Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domains

The distribution of the flora in the alpine zone

Paul Jaccard · 1912

Earlier work this paper cites.

Simple statistical gradient-following algorithms for connectionist reinforcement learning

Ronald J Williams · 1992

Earlier work this paper cites.

Buy 4 reinforce samples, get a baseline for free!

Wouter Kool, Herke van Hoof, and Max Welling · 2019

Earlier work this paper cites.

Learning to summarize with human feedback

Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul F Christiano · 2020

Earlier work this paper cites.

Program synthesis with large language models

Original

Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, Michael Terry, Quoc Le, et al · 2021

Earlier work this paper cites.

Show your work: Scratchpads for intermediate computation with language models

Maxwell Nye, Anders Johan Andreassen, Guy Gur-Ari, Henryk Michalewski, Jacob Austin, David Bieber, David Dohan, Aitor Lewkowycz, Maarten Bosma, David Luan, et al · 2021

Earlier work this paper cites.

Self-teaching machines to read and comprehend with large-scale multi-subject question-answering data

Dian Yu, Kai Sun, Dong Yu, and Claire Cardie · 2021

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al · 2022

Earlier work this paper cites.

Star: Bootstrapping reasoning with reasoning

Eric Zelikman, Yuhuai Wu, Jesse Mu, and Noah Goodman · 2022

Earlier work this paper cites.

Let’s verify step by step

Original

Hunter Lightman, Vineet Kosaraju, Yura Burda, Harri Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe · 2023

Earlier work this paper cites.

Judging llm-as-a-judge with mt-bench and chatbot arena

Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, et al · 2023

Cited alongside, same era.

Back to basics: Revisiting reinforce style optimization for learning from human feedback in llms

Original

Arash Ahmadian, Chris Cremer, Matthias Gallé, Marzieh Fadaee, Julia Kreutzer, Olivier Pietquin, Ahmet Üstün, and Sara Hooker · 2024

Cited alongside, same era.

Huatuogpt-o1, towards medical complex reasoning with llms

Original

Junying Chen, Zhenyang Cai, Ke Ji, Xidong Wang, Wanlong Liu, Rongsheng Wang, Jianye Hou, and Benyou Wang · 2024

Cited alongside, same era.

Stream of search (sos): Learning to search in language

Kanishk Gandhi, Denise HJ Lee, Gabriel Grand, Muxin Liu, Winson Cheng, Archit Sharma, and Noah Goodman · 2024

Cited alongside, same era.

Rlef: Grounding code llms in execution feedback with reinforcement learning

Mammoth2: Scaling instructions from the web

Original

Xiang Yue, Tuney Zheng, Ge Zhang, and Wenhu Chen · 2024

Later among the works it cites.

Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning

Original

Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, et al · 2025

Closest in time.

Reinforce++: A simple and efficient approach for aligning large language models

Original

Jian Hu · 2025

Closest in time.

Code-r1: Reproducing r1 for code with reliable rewards

Jiawei Liu and Lingming Zhang · 2025

Closest in time.

Deepscaler: Surpassing o1-preview with a 1.5b model by scaling rl, 2025

Michael Luo, Sijun Tan, Justin Wong, Xiaoxiang Shi, William Y. Tang, Manan Roongta, Colin Cai, Jeffrey Luo, Tianjun Zhang, Li Erran Li, Raluca Ada Popa, and Ion Stoica · 2025