DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning

Roberta: A robustly optimized BERT pretraining approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov · 1907

Earlier work this paper cites.

Fine-tuning language models from human preferences

Original

Daniel M. Ziegler, Nisan Stiennon, Jeffrey Wu, Tom B. Brown, Alec Radford, Dario Amodei, Paul F. Christiano, and Geoffrey Irving · 1909

Earlier work this paper cites.

Advantage-weighted regression: Simple and scalable off-policy reinforcement learning

Original

Xue Bin Peng, Aviral Kumar, Grace Zhang, and Sergey Levine · 1910

Earlier work this paper cites.

Approximately optimal approximate reinforcement learning

Sham M. Kakade and John Langford · 2002

Earlier work this paper cites.

Accelerating online reinforcement learning with offline datasets

Original

Ashvin Nair, Murtaza Dalal, Abhishek Gupta, and Sergey Levine · 2006

Earlier work this paper cites.

Prioritized level replay

Original

Minqi Jiang, Edward Grefenstette, and Tim Rocktäschel · 2010

Earlier work this paper cites.

Trust region policy optimization

Original

John Schulman, Sergey Levine, Philipp Moritz, Michael I. Jordan, and Pieter Abbeel · 2015

Earlier work this paper cites.

Deep reinforcement learning with double q-learning

Original

Hado van Hasselt, Arthur Guez, and David Silver · 2015

Earlier work this paper cites.

Prioritized experience replay, 2016

Tom Schaul, John Quan, Ioannis Antonoglou, and David Silver · 2016

Earlier work this paper cites.

Proximal policy optimization algorithms

Original

John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov · 2017

Earlier work this paper cites.

World of bits: An open-domain platform for web-based agents

Tianlin Shi, Andrej Karpathy, Linxi Fan, Jonathan Hernandez, and Percy Liang · 2017

Earlier work this paper cites.

High-dimensional continuous control using generalized advantage estimation, 2018

John Schulman, Philipp Moritz, Sergey Levine, Michael Jordan, and Pieter Abbeel · 2018

Earlier work this paper cites.

Solving rubik’s cube with a robot hand, 2019

OpenAI, Ilge Akkaya, Marcin Andrychowicz, Maciek Chociej, Mateusz Litwin, Bob McGrew, Arthur Petron, Alex Paino, Matthias Plappert, Glenn Powell, Raphael Ribas, Jonas Schneider, Nikolas Tezak, Jerry Tworek, Peter Welinder, Lilian Weng, Qiming Yuan, Wojciech Zaremba, and Lei Zhang · 2019

Earlier work this paper cites.

Why Generalization in RL is Difficult: Epistemic POMDPs and Implicit Partial Observability

Dibya Ghosh, Jad Rahme, Aviral Kumar, Amy Zhang, Ryan P Adams, and Sergey Levine · 2021

Earlier work this paper cites.

Androidenv: A reinforcement learning platform for android

Original

Daniel Toyama, Philippe Hamel, Anita Gergely, Gheorghe Comanici, Amelia Glaese, Zafarali Ahmed, Tyler Jackson, Shibl Mourad, and Doina Precup · 2021

Earlier work this paper cites.

Critic regularized regression, 2021

Ziyu Wang, Alexander Novikov, Konrad Zolna, Jost Tobias Springenberg, Scott Reed, Bobak Shahriari, Noah Siegel, Josh Merel, Caglar Gulcehre, Nicolas Heess, and Nando de Freitas · 2021

Earlier work this paper cites.

A data-driven approach for learning to control computers, 2022

Peter C Humphreys, David Raposo, Toby Pohlen, Gregory Thornton, Rachita Chhaparia, Alistair Muldal, Josh Abramson, Petko Georgiev, Alex Goldin, Adam Santoro, and Timothy Lillicrap · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Original

Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke E. Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Francis Christiano, Jan Leike, and Ryan J. Lowe · 2022

Earlier work this paper cites.

Chai: A chatbot ai for task-oriented dialogue with offline reinforcement learning, 2022

Siddharth Verma, Justin Fu, Mengjiao Yang, and Sergey Levine · 2022

Cited alongside, same era.

Lmrl gym: Benchmarks for multi-turn reinforcement learning with language models, 2023

Marwa Abdulhai, Isadora White, Charlie Snell, Charles Sun, Joey Hong, Yuexiang Zhai, Kelvin Xu, and Sergey Levine · 2023

Cited alongside, same era.

Open problems and fundamental limitations of reinforcement learning from human feedback, 2023

Stephen Casper, Xander Davies, Claudia Shi, Thomas Krendl Gilbert, Jérémy Scheurer, Javier Rando, Rachel Freedman, Tomasz Korbak, David Lindner, Pedro Freire, Tony Wang, Samuel Marks, Charbel-Raphaël Segerie, Micah Carroll, Andi Peng, Phillip Christoffersen, Mehul Damani, Stewart Slocum, Usman Anwar, Anand Siththaranjan, Max Nadeau, Eric J. Michaud, Jacob Pfau, Dmitrii Krasheninnikov, Xin Chen, Lauro Langosco, Peter Hase, Erdem Bıyık, Anca Dragan, David Krueger, Dorsa Sadigh, and Dylan Hadfield-Menell · 2023

Cited alongside, same era.

Fireact: Toward language agent fine-tuning

Original

Baian Chen, Chang Shu, Ehsan Shareghi, Nigel Collier, Karthik Narasimhan, and Shunyu Yao · 2023

Cited alongside, same era.

You only look at screens: Multimodal chain-of-action agents, 2023

Zhuosheng Zhang and Aston Zhang · 2023

Later among the works it cites.

Webarena: A realistic web environment for building autonomous agents

Original

Shuyan Zhou, Frank F. Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Yonatan Bisk, Daniel Fried, Uri Alon, and Graham Neubig · 2023

Later among the works it cites.

Workarena: How capable are web agents at solving common knowledge work tasks?, 2024

Alexandre Drouin, Maxime Gasse, Massimo Caccia, Issam H. Laradji, Manuel Del Verme, Tom Marty, Léo Boisvert, Megh Thakkar, Quentin Cappart, David Vazquez, Nicolas Chapados, and Alexandre Lacoste · 2024

Closest in time.

Stop regressing: Training value functions via classification for scalable deep rl, 2024

Jesse Farebrother, Jordi Orbay, Quan Vuong, Adrien Ali Taïga, Yevgen Chebotar, Ted Xiao, Alex Irpan, Sergey Levine, Pablo Samuel Castro, Aleksandra Faust, Aviral Kumar, and Rishabh Agarwal · 2024

Closest in time.

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context, 2024b