Fetching the paper…
Reading the bibliography…
As large language models (LLM) evolve in their capabilities, various recent studies have tried to quantify their behavior using psychological tools created to study human behavior.
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901
Earlier work this paper cites.
The curious case of neural text degeneration
Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2019 · 1904
Earlier work this paper cites.
A technique for the measurement of attitudes
Rensis Likert. 1932 · 1932
Earlier work this paper cites.
A basis for analyzing test-retest reliability
Louis Guttman. 1945 · 1945
Earlier work this paper cites.
Coefficient alpha and the internal structure of tests
Lee J Cronbach. 1951 · 1951
Earlier work this paper cites.
Personality structure: Emergence of the five-factor model
John M Digman. 1990 · 1990
Earlier work this paper cites.
An alternative" description of personality": the big-five factor structure
Lewis R Goldberg. 1990 · 1990
Earlier work this paper cites.
The structure of phenotypic personality traits
Lewis R Goldberg. 1993 · 1993
Earlier work this paper cites.
The five-factor model of personality: Theoretical perspectives
Jerry S Wiggins. 1996 · 1996
Earlier work this paper cites.
Test validity: A matter of consequence
Samuel Messick. 1998 · 1998
Earlier work this paper cites.
The big five personality factors: the psycholexical approach to personality
Boele De Raad. 2000 · 2000
Earlier work this paper cites.
Does response scale format affect the answering of personality scales? assessing the big five dimensions of personality with different response scales in a dependent sample
Beatrice Rammstedt and Dagmar Krebs. 2007 · 2007
Earlier work this paper cites.
The mann-whitney u: A test for assessing whether two independent samples come from the same distribution
Nadim Nachar et al. 2008 · 2008
Earlier work this paper cites.
Test theory: A unified treatment
Roderick P McDonald. 2013 · 2013
Earlier work this paper cites.
Measuring thirty facets of the five factor model with a 120-item public domain inventory: Development of the ipip-neo-120
John A Johnson. 2014 · 2014
Cited alongside, same era.
Improving language understanding by generative pre-training
Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al. 2018 · 2018
Cited alongside, same era.
Constructing validity: New developments in creating objective measuring instruments
Lee Anna Clark and David Watson. 2019 · 2019
Cited alongside, same era.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019
Cited alongside, same era.
Identifying and manipulating the personality traits of language models
Graham Caron and Shashank Srivastava. 2022 · 2022
Cited alongside, same era.
Opt: Open pre-trained transformer language models
Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, et al. 2022 · 2022
Later among the works it cites.
Definition of Personality
American Psychological Association. 2023 · 2023
Closest in time.
Bojana Bodroza, Bojana M Dinic, and Ljubisa Bojic. 2023 · 2023
Closest in time.
When large language models meet personalization: Perspectives of challenges and opportunities
Jin Chen, Zheng Liu, Xu Huang, Chenwang Wu, Qi Liu, Gangwei Jiang, Yuanhao Pu, Yuxuan Lei, Xiaolong Chen, Xingmei Wang, et al. 2023 · 2023
Closest in time.
Gpts are gpts: An early look at the labor market impact potential of large language models
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al. 2022 · 2022
Cited alongside, same era.
Mpi: Evaluating and inducing personality in pre-trained language models
Guangyuan Jiang, Manjie Xu, Song-Chun Zhu, Wenjuan Han, Chi Zhang, and Yixin Zhu. 2022 · 2022
Cited alongside, same era.
Estimating the personality of white-box language models
Saketh Reddy Karra, Theja Tulabandhula, et al. 2022 · 2022
Cited alongside, same era.
Who is gpt-3? an exploration of personality, values and demographics
Marilù Miotto, Nicola Rossberg, and Bennett Kleinberg. 2022 · 2022
Cited alongside, same era.
Chatgpt - https://openai.com/blog/chatgpt#OpenAI
OpenAI. 2022 · 2022
Cited alongside, same era.
Training language models to follow instructions with human feedback
Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022 · 2022
Cited alongside, same era.
Effects of response option order on likert-type psychometric properties and reactions
Chet Robie, Adam W Meade, Stephen D Risavy, and Sabah Rasheed. 2022 · 2022
Cited alongside, same era.
Tyna Eloundou, Sam Manning, Pamela Mishkin, and Daniel Rock. 2023 · 2023
Closest in time.
Chatgpt an enfj, bard an istj: Empirical study on personalities of large language models
Jen-tse Huang, Wenxuan Wang, Man Ho Lam, Eric John Li, Wenxiang Jiao, and Michael R Lyu. 2023 · 2023
Closest in time.
Large language models in education: A focus on the complementary relationship between human teachers and chatgpt
Jaeho Jeon and Seongyong Lee. 2023 · 2023
Closest in time.
Ai text-to-behavior: A study in steerability
David Noever and Sam Hyams. 2023 · 2023
Closest in time.
Gpt-4 technical report - https://cdn.openai.com/papers/gpt-4.pdf
OpenAI. 2023 · 2023
Closest in time.
Do llms possess a personality? making the mbti test an amazing evaluation for large language models
Keyu Pan and Yawen Zeng. 2023 · 2023
Closest in time.
Large language models sensitivity to the order of options in multiple-choice questions
Pouya Pezeshkpour and Estevam Hruschka. 2023 · 2023
Closest in time.
Personality traits in large language models
Mustafa Safdari, Greg Serapio-García, Clément Crepy, Stephen Fitz, Peter Romero, Luning Sun, Marwa Abdulhai, Aleksandra Faust, and Maja Matarić. 2023 · 2023
Closest in time.
Xiaoyang Song, Akshat Gupta, Kiyan Mohebbizadeh, Shujie Hu, and Anant Singh. 2023 · 2023
Closest in time.