Can Language Models Reason about Individualistic Human Values and Preferences?

Q Methodology , pages 215–239

Paul Stenner, S. Watts, and M. Worrell. 2008 · 2008

Earlier work this paper cites.

Chapter 1 - mental representations of social values

Gregory R. Maio. 2010 · 2010

Earlier work this paper cites.

An overview of the schwartz theory of basic values

Shalom H. Schwartz. 2012 · 2012

Earlier work this paper cites.

Proximal policy optimization algorithms

Original

John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017 · 2017

Earlier work this paper cites.

Predicting demographics, moral foundations, and human values from digital behaviours

Kyriaki Kalimeri, Mariano G. Beiró, Matteo Delfino, Robert Raleigh, and Ciro Cattuto. 2019 · 2019

Earlier work this paper cites.

Intrinsic vs. Extrinsic Value

Michael J. Zimmerman and Ben Bradley. 2019 · 2019

Earlier work this paper cites.

Incommensurable Values

Nien-hê Hsieh and Henrik Andersson. 2021 · 2021

Earlier work this paper cites.

Training a helpful and harmless assistant with reinforcement learning from human feedback

Original

Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, Nicholas Joseph, Saurav Kadavath, Jackson Kernion, Tom Conerly, Sheer El-Showk, Nelson Elhage, Zac Hatfield-Dodds, Danny Hernandez, Tristan Hume, Scott Johnston, Shauna Kravec, Liane Lovitt, Neel Nanda, Catherine Olsson, Dario Amodei, Tom Brown, Jack Clark, Sam McCandlish, Chris Olah, Ben Mann, and Jared Kaplan. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Original

Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe. 2022 · 2022

Earlier work this paper cites.

Social simulacra: Creating populated prototypes for social computing systems

Joon Sung Park, Lindsay Popowski, Carrie Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2022 · 2022

Earlier work this paper cites.

Beyond goldfish memory: Long-term open-domain conversation

Jing Xu, Arthur Szlam, and Jason Weston. 2022 · 2022

Earlier work this paper cites.

Personalized soups: Personalized large language model alignment via post-hoc parameter merging

Original

Joel Jang, Seungone Kim, Bill Yuchen Lin, Yizhong Wang, Jack Hessel, Luke Zettlemoyer, Hannaneh Hajishirzi, Yejin Choi, and Prithviraj Ammanabrolu. 2023 · 2023

Earlier work this paper cites.

Evaluating and inducing personality in pre-trained language models

Guangyuan Jiang, Manjie Xu, Song-Chun Zhu, Wenjuan Han, Chi Zhang, and Yixin Zhu. 2023 · 2023

Earlier work this paper cites.

Value Pluralism

Elinor Mason. 2023 · 2023

Earlier work this paper cites.

Sample efficient reinforcement learning from human feedback via active exploration

Original

Viraj Mehta, Vikramjeet Das, Ojash Neopane, Yijia Dai, Ilija Bogunovic, Jeff Schneider, and Willie Neiswanger. 2023 · 2023

Earlier work this paper cites.

Pearl: Personalizing large language model writing assistants with generation-calibrated retrievers

Original

Sheshera Mysore, Zhuoran Lu, Mengting Wan, Longqi Yang, Steve Menezes, Tina Baghaee, Emmanuel Barajas Gonzalez, Jennifer Neville, and Tara Safavi. 2023 · 2023

Earlier work this paper cites.

Whose opinions do language models reflect?

Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, and Tatsunori Hashimoto. 2023 · 2023

Cited alongside, same era.

Personality traits in large language models

Original

Greg Serapio-García, Mustafa Safdari, Clément Crepy, Luning Sun, Stephen Fitz, Peter Romero, Marwa Abdulhai, Aleksandra Faust, and Maja Matarić. 2023 · 2023

Cited alongside, same era.

Persona: A reproducible testbed for pluralistic alignment

Original

Louis Castricato, Nathan Lile, Rafael Rafailov, Jan-Philipp Fränken, and Chelsea Finn. 2024 · 2024

Cited alongside, same era.

Towards measuring the representation of subjective global opinions in language models

Original

Esin Durmus, Karina Nguyen, Thomas I. Liao, Nicholas Schiefer, Amanda Askell, Anton Bakhtin, Carol Chen, Zac Hatfield-Dodds, Danny Hernandez, Nicholas Joseph, Liane Lovitt, Sam McCandlish, Orowa Sikder, Alex Tamkin, Janel Thamkul, Jared Kaplan, Jack Clark, and Deep Ganguli. 2024 · 2024

Cited alongside, same era.

Blend: A benchmark for llms on everyday knowledge in diverse cultures and languages

Original

Jun-Hee Myung, Nayeon Lee, Yi Zhou, Jiho Jin, Rifki Afina Putri, Dimosthenis Antypas, Hsuvas Borkakoty, Eunsu Kim, Carla Pérez-Almendros, Abinew Ali Ayele, V’ictor Guti’errez-Basulto, Yazm’in Ib’anez-Garc’ia, Hwaran Lee, Shamsuddeen Hassan Muhammad, Kiwoong Park, Anar Rzayev, Nina White, Seid Muhie Yimam, Mohammad Taher Pilehvar, Nedjma Djouhra Ousidhoum, José Camacho-Collados, and Alice Oh. 2024 · 2024

Closest in time.

Pew research center

Pew Research Center. n.d · 2024

Closest in time.

Active preference inference using language models and probabilistic reasoning

Original

Wasu Top Piriyakulkij, Volodymyr Kuleshov, and Kevin Ellis. 2024 · 2024

Closest in time.

Personalizing reinforcement learning from human feedback with variational preference learning

Original

Sriyash Poddar, Yanming Wan, Hamish Ivison, Abhishek Gupta, and Natasha Jaques. 2024 · 2024

Closest in time.