Large Language Models Show Human-like Social Desirability Biases in Survey Responses

D. T. Campbell and D. W. Fiske, “Convergent and discriminant validation by the multitrait-multimethod matrix.,” Psychological bulletin

1959

Earlier work this paper cites.

N. Schwarz, “Self-reports: How the questions shape the answers.,” American psychologist

1999

Earlier work this paper cites.

L. R. Goldberg et al

1999

Earlier work this paper cites.

T. Holtgraves, “Social desirability and self-reports: Testing models of socially desirable responding,” Personality and Social Psychology Bulletin

2004

Earlier work this paper cites.

B. W. Roberts, N. R. Kuncel, R. Shiner, A. Caspi, and L. R. Goldberg, “The power of personality: The comparative validity of personality traits, socioeconomic status, and cognitive ability for predicting important life outcomes,” Perspectives on Psychological science

2007

Earlier work this paper cites.

B. T. Hughes, C. K. Costello, J. Pearman, P. Razavi, C. Bedford-Petersen, R. M. Ludwig, and S. Srivastava, “The big five across socioeconomic status: Measurement invariance, relationships, and age trends,” Collabra: Psychology

2021

Earlier work this paper cites.

J. Wei, Y. Tay, R. Bommasani, C. Raffel, B. Zoph, S. Borgeaud, D. Yogatama, M. Bosma, D. Zhou, D. Metzler, et al

Original

2022

Cited alongside, same era.

J. K. Wood, J. Anglim, and S. Horwood, “A less evaluative measure of big five personality: Comparison of structure and criterion validity,” European Journal of Personality

2022

Cited alongside, same era.

D. M. Dueber, M. D. Toland, J. E. Lingat, A. M. Love, C. Qiu, R. Wu, and A. V. Brown, “To reverse item orientation or not to reverse item orientation, that is the question,” Assessment

2022

Cited alongside, same era.

G. V. Aher, R. I. Arriaga, and A. T. Kalai, “Using large language models to simulate multiple humans and replicate human subject studies,” in International Conference on Machine Learning

2023

Cited alongside, same era.

D. Dillion, N. Tandon, Y. Gu, and K. Gray, “Can ai language models replace human participants?,” Trends in Cognitive Sciences

2023

Later among the works it cites.

M. Safdari, G. Serapio-García, C. Crepy, S. Fitz, P. Romero, L. Sun, M. Abdulhai, A. Faust, and M. Matarić, “Personality traits in large language models,” arXiv preprint arXiv:2307.00184

Original

2023

Later among the works it cites.

M. Binz and E. Schulz, “Using cognitive psychology to understand gpt-3,” Proceedings of the National Academy of Sciences

2023

Later among the works it cites.

V. Dentella, F. Günther, and E. Leivada, “Systematic testing of three language models reveals low language accuracy, absence of response stability, and a yes-response bias,” Proceedings of the National Academy of Sciences

2023

Later among the works it cites.