Social Science Meets LLMs: How Reliable Are Large Language Models in Social Simulations?

Dual coding theory: Retrospect and current status

Allan Paivio. 1991 · 1991

Earlier work this paper cites.

Agent-based modeling: A new approach for theory building in social psychology

Eliot R Smith and Frederica R Conrey. 2007 · 2007

Earlier work this paper cites.

Grounded cognition

Lawrence W Barsalou. 2008 · 2008

Earlier work this paper cites.

Language and simulation in conceptual processing

Lawrence W Barsalou, Ava Santos, W Kyle Simmons, and Christine D Wilson. 2008 · 2008

Earlier work this paper cites.

Social self-organization: Agent-based simulations and experiments to study emergent social behavior

Dirk Helbing. 2012 · 2012

Earlier work this paper cites.

Can robots be lawyers: Computers, lawyers, and the practice of law

Dana Remus and Frank Levy. 2017 · 2017

Earlier work this paper cites.

Ethics in planning

Martin Wachs. 2017 · 2017

Earlier work this paper cites.

Simulating societies: the computer simulation of social phenomena

Nigel Gilbert and Jim Doran. 2018 · 2018

Earlier work this paper cites.

When to make exceptions: Exploring language models as accounts of human moral judgment

Zhijing Jin, Sydney Levine, Fernando Gonzalez Adauto, Ojasv Kamal, Maarten Sap, Mrinmaya Sachan, Rada Mihalcea, Josh Tenenbaum, and Bernhard Schölkopf. 2022 · 2022

Earlier work this paper cites.

Social simulacra: Creating populated prototypes for social computing systems

Joon Sung Park, Lindsay Popowski, Carrie Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2022 · 2022

Earlier work this paper cites.

Emergent abilities of large language models

Original

Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, et al. 2022 · 2022

Earlier work this paper cites.

Using large language models to simulate multiple humans and replicate human subject studies

Gati V Aher, Rosa I Arriaga, and Adam Tauman Kalai. 2023 · 2023

Earlier work this paper cites.

Out of one, many: Using language models to simulate human samples

Lisa P Argyle, Ethan C Busby, Nancy Fulda, Joshua R Gubler, Christopher Rytting, and David Wingate. 2023 · 2023

Earlier work this paper cites.

What can large language models do in chemistry? a comprehensive benchmark on eight tasks

Taicheng Guo, kehan Guo, Bozhao Nan, Zhenwen Liang, Zhichun Guo, Nitesh Chawla, Olaf Wiest, and Xiangliang Zhang. 2023 · 2023

Earlier work this paper cites.

War and peace (waragent): Large language model-based multi-agent simulation of world wars

Original

Wenyue Hua, Lizhou Fan, Lingyao Li, Kai Mei, Jianchao Ji, Yingqiang Ge, Libby Hemphill, and Yongfeng Zhang. 2023 · 2023

Earlier work this paper cites.

Econagent: Large language model-empowered agents for simulating macroeconomic activities

Nian Li, Chen Gao, Mingyu Li, Yong Li, and Qingmin Liao. 2023 · 2023

Earlier work this paper cites.

Do llms possess a personality? making the mbti test an amazing evaluation for large language models

Original

Keyu Pan and Yawen Zeng. 2023 · 2023

Earlier work this paper cites.

Generative agents: Interactive simulacra of human behavior

Joon Sung Park, Joseph O’Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. 2023 · 2023

Cited alongside, same era.

Exploring large language models for communication games: An empirical study on werewolf

Original

Yuzhuang Xu, Shuo Wang, Peng Li, Fuwen Luo, Xiaolong Wang, Weidong Liu, and Yang Liu. 2023 · 2023

Cited alongside, same era.

Competeai: Understanding the competition behaviors in large language model-based agents

Original

Qinlin Zhao, Jindong Wang, Yixuan Zhang, Yiqiao Jin, Kaijie Zhu, Hao Chen, and Xing Xie. 2023 · 2023

Cited alongside, same era.

Judging llm-as-a-judge with mt-bench and chatbot arena

Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, et al. 2023 · 2023

Cited alongside, same era.

Let the llms talk: Simulating human-to-human conversational qa via zero-shot llm-to-llm interactions

Generative students: Using llm-simulated student profiles to support question item evaluation

Xinyi Lu and Xu Wang. 2024 · 2024

Closest in time.

Representation bias in political sample simulations with large language models

Original

Weihong Qi, Hanjia Lyu, and Jiebo Luo. 2024 · 2024

Closest in time.

Llm harmony: Multi-agent communication for problem solving

Original

Sumedh Rasal. 2024 · 2024

Closest in time.

Gpt is an effective tool for multilingual psychological text analysis

Steve Rathje, Dan-Mircea Mirea, Ilia Sucholutsky, Raja Marjieh, Claire E Robertson, and Jay J Van Bavel. 2024 · 2024

Closest in time.

Artificial intelligence to automate health economic modelling: A case study to evaluate the potential application of large language models

Tim Reason, William Rawlinson, Julia Langham, Andy Gimblett, Bill Malcolm, and Sven Klijn. 2024 · 2024