Of Models and Tin Men: A Behavioural Economics Study of Principal-Agent Problems in AI Alignment using Large-Language Models

E. Hubinger, C. van Merwijk, V. Mikulik, J. Skalse, and S. Garrabrant, “Risks from Learned Optimization in Advanced Machine Learning Systems,” arXiv:1906.01820

Original

1906

Earlier work this paper cites.

C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu, “T5: Exploring the limits of transfer learning with a unified text-to-text transformer,” Journal of Machine Learning Research

Original

1910

Earlier work this paper cites.

M. Jensen and W. H. Meckling, “Theory of the firm: Managerial behavior, agency costs and ownership structure,” Journal of Financial Economics

1976

Earlier work this paper cites.

D. Cliff, “Evolution of market mechanism through a continuous space of auction-types,” Technical report HPL-2001-326, HP Labs, 2001

2001

Earlier work this paper cites.

J. C. J. M. van den Bergh and S. Stagl, “Coevolution of economic behaviour and institutions: towards a theory of institutional change,” Journal of Evolutionary Economics

2003

Earlier work this paper cites.

T. B. Brown, B. Mann, et al

Original

2005

Earlier work this paper cites.

K. Alexander, “Corporate governance and banks: The role of regulation in reducing the principal-agent problem,” Journal of Banking regulation

2006

Earlier work this paper cites.

Thesis (phd), University of Liverpool, 2007

S. Phelps, Evolutionary mechanism design · 2007

Earlier work this paper cites.

S. Gehman, S. Gururangan, M. Sap, Y. Choi, and N. A. Smith, “REALTOXICITYPROMPTS: Evaluating neural toxic degeneration in language models,” Findings of ACL: EMNLP 2020

Original

2009

Earlier work this paper cites.

E. R. Lai, “Metacognition: A literature review,” Always learning: Pearson research report

2011

Earlier work this paper cites.

P. F. Christiano, J. Leike, T. B. Brown, M. Martic, S. Legg, and D. Amodei, “Deep reinforcement learning from human preferences,” Advances in Neural Information Processing Systems

Original

2017

Cited alongside, same era.

Curran Associates, Inc., 2018

B. Ibarz, J. Leike, T. Pohlen, G. Irving, S. Legg, and D. Amodei, “Reward learning from human preferences and demonstrations in Atari,” in Advances in Neural Information Processing Systems · 2018

Cited alongside, same era.

Oxford University Press, 2021

S. Russell, “Human-compatible artificial intelligence,” in Human-like Machine Intelligence · 2021

Cited alongside, same era.

J. Wei, X. Wang, D. Schuurmans, M. Bosma, B. Ichter, F. Xia, E. Chi, Q. Le, and D. Zhou, “Chain-of-Thought Prompting Elicits Reasoning in Large Language Models,” Advances in Neural Information Processing Systems

Original

2022

Cited alongside, same era.

S. Bubeck, V. Chandrasekaran, et al

2023

Cited alongside, same era.

T. Johnson and N. Obradovich, “Evidence of Behavior Consistent with Self-Interest and Altruism in An Artificially Intelligent Agent,” SSRN Electronic Journal

2023

Closest in time.

arXiv:2305.17126

Original

C. Yang, X. Wang, Y. Lu, H. Liu, Q. V. Le, D. Zhou, and X. Chen, “Large Language Models as Optimizers,” tech. rep., Google DeepMind, 2023 · 2023

Closest in time.

M. Binz and E. Schulz, “Using cognitive psychology to understand gpt-3,” Proceedings of the National Academy of Sciences

2023

Closest in time.

Association for Computing Machinery, 2023

Original

J. S. Park, J. C. O’Brien, C. J. Cai, M. R. Morris, P. Liang, and M. S. Bernstein, Generative Agents: Interactive Simulacra of Human Behavior · 2023

Closest in time.

https://github.com/Significant-Gravitas/Auto-GPT

T. B. Richards, “AutoGTP.” 2023 · 2023