Fetching the paper…
Reading the bibliography…
Uncontrollable autonomous replication of language model agents poses a critical safety risk.
The economics of botnets
Yuri Namestnikov · 2009
Earlier work this paper cites.
The pile: An 800gb dataset of diverse text for language modeling, 2020
Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, Shawn Presser, and Connor Leahy · 2020
Earlier work this paper cites.
Evaluating large language models trained on code, 2021
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Josh Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, and Wojciech Zaremba · 2021
Earlier work this paper cites.
GAIA: a benchmark for general AI assistants, 2023
Grégoire Mialon, Clémentine Fourrier, Craig Swift, Thomas Wolf, Yann LeCun, and Thomas Scialom · 2023
Earlier work this paper cites.
Openai evals
OpenAI · 2023
Earlier work this paper cites.
OpenAI preparedness framework (beta)
OpenAI · 2023
Earlier work this paper cites.
React: Synergizing reasoning and acting in language models
Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao · 2023
Earlier work this paper cites.
Pre-deployment evaluation of openai’s o1 model, Dec 2024
UK AISI · 2024
Earlier work this paper cites.
The Intelligence Age, 2024
Sam Altman · 2024
Earlier work this paper cites.
Machines of Loving Grace, 2024
Dario Amodei · 2024
Earlier work this paper cites.
Anthropic responsible scaling policy
Anthropic · 2024
Earlier work this paper cites.
MLE-bench: Evaluating machine learning agents on machine learning engineering, 2024
Jun Shern Chan, Neil Chowdhury, Oliver Jaffe, James Aung, Dane Sherburn, Evan Mays, Giulio Starace, Kevin Liu, Leon Maksin, Tejal Patwardhan, Lilian Weng, and Aleksander Mądry · 2024
Earlier work this paper cites.
SWE-bench verified: Human-validated subset of swe-bench, 2024
Neil Chowdhury, James Aung, Chan Jun Shern, Oliver Jaffe, Dane Sherburn, Giulio Starace, Evan Mays, Rachel Dias, Marwan Aljubeh, Mia Glaese, Carlos E. Jimenez, John Yang, Kevin Liu, and Aleksander Madry · 2024
Cited alongside, same era.
Magentic-one: A generalist multi-agent system for solving complex tasks
Adam Fourney, Gagan Bansal, Hussein Mozannar, Cheng Tan, Eduardo Salinas, Friederike Niedtner, Grace Proebsting, Griffin Bassman, Jack Gerrits, Jacob Alber, et al · 2024
Cited alongside, same era.
Frontier safety framework, version 1.0
Google DeepMind · 2024
Cited alongside, same era.
Fred Heiding, Simon Lermen, Andrew Kao, Bruce Schneier, and Arun Vishwanath · 2024
Cited alongside, same era.
Evaluating frontier models for dangerous capabilities, 2024
Mary Phuong, Matthew Aitchison, Elliot Catt, Sarah Cogan, Alexandre Kaskasoli, Victoria Krakovna, David Lindner, Matthew Rahtz, Yannis Assael, Sarah Hodkinson, Heidi Howard, Tom Lieberum, Ramana Kumar, Maria Abi Raad, Albert Webson, Lewis Ho, Sharon Lin, Sebastian Farquhar, Marcus Hutter, Gregoire Deletang, Anian Ruoss, Seliem El-Sayed, Sasha Brown, Anca Dragan, Rohin Shah, Allan Dafoe, and Toby Shevlane · 2024
Later among the works it cites.
Memorandum on advancing the United States’ leadership in artificial intelligence; harnessing artificial intelligence to fulfill national security objectives; and fostering the safety, security, and trustworthiness of artificial intelligence, October 24 2024
The White House · 2024
Later among the works it cites.
Inspect AI: Framework for Large Language Model Evaluations, May 2024
UK AI Security Institute · 2024
Later among the works it cites.
Recital 110 of the eu artificial intelligence act, 2024
European Union · 2024
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Peter Jansen, Marc-Alexandre Côté, Tushar Khot, Erin Bransom, Bhavana Dalvi Mishra, Bodhisattwa Prasad Majumder, Oyvind Tafjord, and Peter Clark · 2024
Cited alongside, same era.
The edgelord ai that turned a shock meme into millions in crypto, Dec 2024
Joel Khalili · 2024
Cited alongside, same era.
Evaluating language-model agents on realistic autonomous tasks, 2024
Megan Kinniment, Lucas Jun Koba Sato, Haoxing Du, Brian Goodrich, Max Hasin, Lawrence Chan, Luke Harold Miles, Tao R. Lin, Hjalmar Wijk, Joel Burget, Aaron Ho, Elizabeth Barnes, and Paul Christiano · 2024
Cited alongside, same era.
The rogue replication threat model
METR · 2024
Cited alongside, same era.
Building an early warning system for llm-aided biological threat creation, 2024
OpenAI · 2024
Cited alongside, same era.
Frontier ai systems have surpassed the self-replicating red line, 2024
Xudong Pan, Jiarun Dai, Yihe Fan, and Min Yang · 2024
Cited alongside, same era.
Llm evaluators recognize and favor their own generations
Arjun Panickssery, Samuel R. Bowman, and Shi Feng · 2024
Cited alongside, same era.
Generative agent simulations of 1,000 people, 2024
Joon Sung Park, Carolyn Q. Zou, Aaron Shaw, Benjamin Mako Hill, Carrie Cai, Meredith Ringel Morris, Robb Willer, Percy Liang, and Michael S. Bernstein · 2024
Cited alongside, same era.
Shengye Wan, Cyrus Nikolaidis, Daniel Song, David Molnar, James Crnkovich, Jayson Grace, Manish Bhatt, Sahana Chennabasappa, Spencer Whitman, Stephanie Ding, Vlad Ionescu, Yue Li, and Joshua Saxe · 2024
Later among the works it cites.
Hjalmar Wijk, Tao Lin, Joel Becker, Sami Jawhar, Neev Parikh, Thomas Broadley, Lawrence Chan, Michael Chen, Josh Clymer, Jai Dhyani, Elena Ericheva, Katharyn Garcia, Brian Goodrich, Nikola Jurkovic, Megan Kinniment, Aron Lajko, Seraphina Nix, Lucas Sato, William Saunders, Maksym Taran, Ben West, and Elizabeth Barnes · 2024
Later among the works it cites.
Swe-agent: Agent-computer interfaces enable automated software engineering, 2024
John Yang, Carlos E. Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press · 2024
Later among the works it cites.
Webarena: A realistic web environment for building autonomous agents, 2024
Shuyan Zhou, Frank F. Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, and Graham Neubig · 2024
Later among the works it cites.
Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari, Imam Nur Bani Yusuf, Haolan Zhan, Junda He, Indraneil Paul, Simon Brunner, Chen Gong, Thong Hoang, Armel Randy Zebaze, Xiaoheng Hong, Wen-Ding Li, Jean Kaddour, Ming Xu, Zhihan Zhang, Prateek Yadav, Naman Jain, Alex Gu, Zhoujun Cheng, Jiawei Liu, Qian Liu, Zijian Wang, David Lo, Binyuan Hui, Niklas Muennighoff, Daniel Fried, Xiaoning Du, Harm de Vries, and Leandro Von Werra · 2024
Later among the works it cites.
Modelling cyber vulnerability using epidemic models
Bao Nguyen · 2025
Closest in time.
Hcast: Human-calibrated autonomy software tasks, 2025
David Rein, Joel Becker, Amy Deng, Seraphina Nix, Chris Canal, Daniel O’Connel, Pip Arnott, Ryan Bloom, Thomas Broadley, Katharyn Garcia, Brian Goodrich, Max Hasin, Sami Jawhar, Megan Kinniment, Thomas Kwa, Aron Lajko, Nate Rush, Lucas Jun Koba Sato, Sydney Von Arx, Ben West, Lawrence Chan, and Elizabeth Barnes · 2025
Closest in time.
Won’t vs. can’t: Sandbagging-like behavior from claude models, 2025
Zach Witten and Joe Benton · 2025
Closest in time.