Scaffolded Language Models with Language Supervision for Mixed-Autonomy: A Survey

Can you trust your model’s uncertainty? evaluating predictive uncertainty under dataset shift, 2019

Original

Yaniv Ovadia, Emily Fertig, Jie Ren, et al · 1906

Earlier work this paper cites.

The early phase of neural network training, 2020

Original

Jonathan Frankle, David J Schwab, Ari S Morcos · 2002

Earlier work this paper cites.

Alfworld: Aligning text and embodied environments for interactive learning

Original

Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté, et al · 2010

Earlier work this paper cites.

Deep learning

Yann LeCun, Yoshua Bengio, Geoffrey Hinton · 2015

Earlier work this paper cites.

Mastering the game of go with deep neural networks and tree search

David Silver, Aja Huang, Chris J Maddison, et al · 2016

Earlier work this paper cites.

Reinforcement Learning: An Introduction

Richard S Sutton, Andrew G Barto · 2018

Earlier work this paper cites.

A survey on deep learning: Algorithms, techniques, and applications

Samira Pouyanfar, Saad Sadiq, Yilin Yan, et al · 2018

Earlier work this paper cites.

Diversity is all you need: Learning skills without a reward function

Benjamin Eysenbach, Abhishek Gupta, Julian Ibarz, et al · 2019

Earlier work this paper cites.

Pytorch: An imperative style, high-performance deep learning library

Adam Paszke, Sam Gross, Francisco Massa, et al · 2019

Earlier work this paper cites.

Critical learning periods in deep neural networks, 2019

Original

Alessandro Achille, Matteo Rovere, Stefano Soatto · 2019

Earlier work this paper cites.

Embracing change: Continual learning in deep neural networks

Raia Hadsell, Dushyant Rao, Andrei A Rusu, et al · 2020

Earlier work this paper cites.

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, et al · 2020

Earlier work this paper cites.

Retrieval-augmented generation for knowledge-intensive nlp tasks

Patrick Lewis, Ethan Perez, Aleksandra Piktus, et al · 2020

Earlier work this paper cites.

Hover: A dataset for many-hop fact extraction and claim verification

Yichen Jiang, Shikha Bordia, Zheng Zhong, et al · 2020

Earlier work this paper cites.

Reinforcement learning is supervised learning on optimized data, 2020

Ben Eysenbach, Aviral Kumar, Abhishek Gupta · 2020

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, et al · 2021

Earlier work this paper cites.

Measuring mathematical problem solving with the MATH dataset

Dan Hendrycks, Collin Burns, Saurav Kadavath, et al · 2021

Earlier work this paper cites.

Measuring massive multitask language understanding

Dan Hendrycks, Collin Burns, Steven Basart, et al · 2021

Earlier work this paper cites.

Leveraging passage retrieval with generative models for open domain question answering

Gautier Izacard, Edouard Grave · 2021

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, et al · 2022

Earlier work this paper cites.

Rlprompt: Optimizing discrete text prompts with reinforcement learning, 2022

Original

Mingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, et al · 2022

Earlier work this paper cites.

TEMPERA: test-time prompting via reinforcement learning

Original

Tianjun Zhang, Xuezhi Wang, Denny Zhou, et al · 2022

Earlier work this paper cites.

Webgpt: Browser-assisted question-answering with human feedback, 2022

Original

Reiichiro Nakano, Jacob Hilton, Suchir Balaji, et al · 2022

Earlier work this paper cites.

Demonstrate-search-predict: Composing retrieval and language models for knowledge-intensive NLP

Original

Omar Khattab, Keshav Santhanam, Xiang Lisa Li, et al · 2022

Earlier work this paper cites.

Language models as agent models

Jacob Andreas · 2022

Earlier work this paper cites.

A mixture of surprises for unsupervised reinforcement learning

Andrew Zhao, Matthieu Lin, Yangguang Li, et al · 2022

Earlier work this paper cites.

The primacy bias in deep reinforcement learning, 2022

Original

Evgenii Nikishin, Max Schwarzer, Pierluca D’Oro, et al · 2022

Earlier work this paper cites.

No, to the right: Online language corrections for robotic manipulation via shared autonomy

Yuchen Cui, Siddharth Karamcheti, Raj Palleti, et al · 2023

Earlier work this paper cites.

Llf-bench: Benchmark for interactive learning from language feedback, 2023

Original

Ching-An Cheng, Andrey Kolobov, Dipendra Misra, et al · 2023

Earlier work this paper cites.

Dspy: Compiling declarative language model calls into self-improving pipelines

Original

Omar Khattab, Arnav Singhvi, Paridhi Maheshwari, et al · 2023

Earlier work this paper cites.

Large language models are human-level prompt engineers

Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, et al · 2023

Earlier work this paper cites.

Automatic prompt optimization with "gradient descent" and beam search

Reid Pryzant, Dan Iter, Jerry Li, et al · 2023

Earlier work this paper cites.

Is your code generated by chatGPT really correct? rigorous evaluation of large language models for code generation

Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang, et al · 2023

Earlier work this paper cites.

Jailbreaking black box large language models in twenty queries, 2023

Original

Patrick Chao, Alexander Robey, Edgar Dobriban, et al · 2023

Earlier work this paper cites.

Embers of autoregression: Understanding large language models through the problem they are trained to solve, 2023

Original

R Thomas McCoy, Shunyu Yao, Dan Friedman, et al · 2023

Earlier work this paper cites.

Studying large language model generalization with influence functions, 2023

Original

Roger Grosse, Juhan Bae, Cem Anil, et al · 2023

Earlier work this paper cites.

In-context retrieval-augmented language models

Ori Ram, Yoav Levine, Itay Dalmedigos, et al · 2023

Earlier work this paper cites.

Generative agents: Interactive simulacra of human behavior

Joon Sung Park, Joseph C O’Brien, Carrie Jun Cai, et al · 2023

Earlier work this paper cites.

Self-consistency improves chain of thought reasoning in language models

Xuezhi Wang, Jason Wei, Dale Schuurmans, et al · 2023

Earlier work this paper cites.

Tree of thoughts: Deliberate problem solving with large language models

Shunyu Yao, Dian Yu, Jeffrey Zhao, et al · 2023

Earlier work this paper cites.

Transformers learn in-context by gradient descent

Johannes Von Oswald, Eyvind Niklasson, Ettore Randazzo, et al · 2023

Earlier work this paper cites.

Reflexion: language agents with verbal reinforcement learning

Noah Shinn, Federico Cassano, Ashwin Gopinath, et al · 2023

Earlier work this paper cites.

Train once, get a family: State-adaptive balances for offline-to-online reinforcement learning

Shenzhi Wang, Qisen Yang, Jiawei Gao, et al · 2023

Earlier work this paper cites.

Theory of mind in large language models: Examining performance of 11 state-of-the-art models vs. children aged 7–10 on advanced tests

Max van Duijn, Bram van Dijk, Tom Kouwenhoven, et al · 2023

Earlier work this paper cites.

Vima: General robot manipulation with multimodal prompts

Yunfan Jiang, Agrim Gupta, Zichen Zhang, et al · 2023

Earlier work this paper cites.

OpenHands: An Open Platform for AI Software Developers as Generalist Agents, 2024

Original

Xingyao Wang, Boxuan Li, Yufan Song, et al · 2024

Earlier work this paper cites.

MLE-bench: Evaluating machine learning agents on machine learning engineering

Original

Jun Shern Chan, Neil Chowdhury, Oliver Jaffe, et al · 2024

Earlier work this paper cites.

What are tools anyway? a survey from the language model perspective

Zhiruo Wang, Zhoujun Cheng, Hao Zhu, et al · 2024

Earlier work this paper cites.

Expel: Llm agents are experiential learners

Andrew Zhao, Daniel Huang, Quentin Xu, et al · 2024

Earlier work this paper cites.

Claude, 2024

Anthropic · 2024

Earlier work this paper cites.

Chatgpt, 2024

OpenAI · 2024

Earlier work this paper cites.

The shift from models to compound ai systems, 2024

Matei Zaharia, Omar Khattab, Lingjiao Chen, et al · 2024

Earlier work this paper cites.

Language agents: From next-token prediction to digital automation

Shunyu Yao · 2024

Cited alongside, same era.

The landscape of emerging AI agent architectures for reasoning, planning, and tool calling: A survey

Original

Tula Masterman, Sandi Besen, Mason Sawtell, et al · 2024

Cited alongside, same era.

Trace is the new autodiff - unlocking efficient optimization of computational workflows

Original

Ching-An Cheng, Allen Nie, Adith Swaminathan · 2024

Cited alongside, same era.

AdalFlow: The Library for Large Language Model (LLM) Applications, 2024

Li Yin · 2024

Cited alongside, same era.

Llm-based optimization of compound ai systems: A survey, 2024

Original

Matthieu Lin, Jenny Sheng, Andrew Zhao, et al · 2024

Cited alongside, same era.

Function calling, 2025

OpenAI · 2025

Closest in time.

Optimizing generative ai by backpropagating language model feedback

Mert Yuksekgonul, Federico Bianchi, Joseph Boen, et al · 2025

Closest in time.

Inducing programmatic skills for agentic tasks, 2025

Original

Zora Zhiruo Wang, Apurva Gandhi, Graham Neubig, et al · 2025

Closest in time.

Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning, 2025

Original

DeepSeek-AI, Daya Guo, Dejian Yang, et al · 2025

Closest in time.

Are my optimized prompts compromised? exploring vulnerabilities of llm-based optimizers, 2025

Original

Andrew Zhao, Reshmi Ghosh, Vitor Carvalho, et al · 2025

Closest in time.