Are Large Language Models Consistent over Value-laden Questions?

Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Good

Original

Xuewei Wang, Weiyan Shi, Richard Kim, Yoojung Oh, Sijia Yang, Jingwen Zhang, and Zhou Yu. 2020 · 1906

Earlier work this paper cites.

Information radius

Robin Sibson. 1969 · 1969

Earlier work this paper cites.

Intransitivity of preferences

Amos Tversky. 1969 · 1969

Earlier work this paper cites.

A Theory of Justice

John Rawls. 1971 · 1971

Earlier work this paper cites.

Universals in the Content and Structure of Values: Theoretical Advances and Empirical Tests in 20 Countries

Shalom H. Schwartz. 1992 · 1992

Earlier work this paper cites.

The international personality item pool and the future of public-domain personality measures

Lewis R. Goldberg, John A. Johnson, Herbert W. Eber, Robert Hogan, Michael C. Ashton, C. Robert Cloninger, and Harrison G. Gough. 2006 · 2006

Earlier work this paper cites.

Dimensionalizing Cultures: The Hofstede Model in Context

Geert Hofstede. 2011 · 2011

Earlier work this paper cites.

Thinking, fast and slow

Daniel Kahneman. 2011 · 2011

Earlier work this paper cites.

Transitivity of preferences

Michel Regenwetter, Jason Dana, and Clintin P. Davis-Stober. 2011 · 2011

Earlier work this paper cites.

An Overview of the Schwartz Theory of Basic Values

Shalom Schwartz. 2012 · 2012

Earlier work this paper cites.

Refining the theory of basic individual values

Shalom H. Schwartz, Jan Cieciuch, Michele Vecchione, Eldad Davidov, Ronald Fischer, Constanze Beierlein, Alice Ramos, Markku Verkasalo, Jan-Erik Lönnqvist, Kursad Demirutku, Ozlem Dirilen-Gumus, and Mark Konty. 2012 · 2012

Earlier work this paper cites.

Linguistic Harbingers of Betrayal: A Case Study on an Online Strategy Game

Vlad Niculae, Srijan Kumar, Jordan Boyd-Graber, and Cristian Danescu-Niculescu-Mizil. 2015 · 2015

Earlier work this paper cites.

Normative Uncertainty as a Voting Problem

William MacAskill. 2016 · 2016

Earlier work this paper cites.

Questionnaire Design

Jon A. Krosnick. 2018 · 2018

Earlier work this paper cites.

Let’s Make Your Request More Persuasive: Modeling Persuasive Strategies via Semi-Supervised Neural Nets on Crowdfunding Platforms

Diyi Yang, Jiaao Chen, Zichao Yang, Dan Jurafsky, and Eduard Hovy. 2019 · 2019

Earlier work this paper cites.

Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data

Emily M. Bender and Alexander Koller. 2020 · 2020

Earlier work this paper cites.

On a Generalization of the Jensen–Shannon Divergence and the Jensen–Shannon Centroid

Frank Nielsen. 2020 · 2020

Earlier work this paper cites.

It Takes Two to Lie: One to Lie, and One to Listen

Denis Peskov, Benny Cheng, Ahmed Elgohary, Joe Barrow, Cristian Danescu-Niculescu-Mizil, and Jordan Boyd-Graber. 2020 · 2020

Earlier work this paper cites.

Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs

Original

Peter Hase, Mona Diab, Asli Celikyilmaz, Xian Li, Zornitsa Kozareva, Veselin Stoyanov, Mohit Bansal, and Srinivasan Iyer. 2021 · 2021

Earlier work this paper cites.

Aligning AI With Shared Human Values

Dan Hendrycks, Collin Burns, Steven Basart, Andrew Critch, Jerry Li, Dawn Song, and Jacob Steinhardt. 2021 · 2021

Earlier work this paper cites.

Delphi: Towards Machine Ethics and Norms

Liwei Jiang, Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Maxwell Forbes, Jon Borchardt, Jenny T. Liang, Oren Etzioni, Maarten Sap, and Yejin Choi. 2021 · 2021

Earlier work this paper cites.

SCRUPLES: A Corpus of Community Ethical Judgments on 32,000 Real-Life Anecdotes

Nicholas Lourie, Ronan Le Bras, and Yejin Choi. 2021 · 2021

Earlier work this paper cites.

A Repository of Schwartz Value Scales with Instructions and an Introduction

Shalom Schwartz. 2021 · 2021

Earlier work this paper cites.

Despite “super-human”

Original

Joshua Albrecht, Ellie Kitanidis, and Abraham J. Fetterman. 2022 · 2022

Earlier work this paper cites.

Experimental Moral Philosophy

Mark Alfano, Edouard Machery, Alexandra Plakias, and Don Loeb. 2022 · 2022

Earlier work this paper cites.

Language Models as Agent Models

Original

Jacob Andreas. 2022 · 2022

Earlier work this paper cites.

Fine-tuning language models to find agreement among humans with diverse preferences

Original

Michiel A. Bakker, Martin J. Chadwick, Hannah R. Sheahan, Michael Henry Tessler, Lucy Campbell-Gillingham, Jan Balaguer, Nat McAleese, Amelia Glaese, John Aslanides, Matthew M. Botvinick, and Christopher Summerfield. 2022 · 2022

Earlier work this paper cites.

General Social Survey, 1972-2022 [Machine-readable data file]

Michael Davern, Rene Bautista, Jeremy Freese, Pamela Herd, and Stephen Morgan. 2022 · 2022

Earlier work this paper cites.

Jury Learning: Integrating Dissenting Voices into Machine Learning Models

Mitchell L. Gordon, Michelle S. Lam, Joon Sung Park, Kayur Patel, Jeff Hancock, Tatsunori Hashimoto, and Michael S. Bernstein. 2022 · 2022

Earlier work this paper cites.

World Values Survey Wave 7 (2017-2022) Cross-National Data-Set

Christian Haerpfer, Ronald Inglehart, Alejandro Moreno, Christian Welzel, Kseniya Kizilova, Jaime Diez-Medrano, Marta Lagos, Pippa Norris, Eduard Ponarin, and Bi Puranen. 2022a · 2022

Earlier work this paper cites.

The Ghost in the Machine has an American accent: value conflict in GPT-3

Original

Rebecca L. Johnson, Giada Pistilli, Natalia Menédez-González, Leslye Denisse Dias Duran, Enrico Panai, Julija Kalpokiene, and Donald Jay Bertulfo. 2022 · 2022

Earlier work this paper cites.

Language Models Understand Us, Poorly

Original

Jared Moore. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Original

Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe. 2022 · 2022

Earlier work this paper cites.

Social Simulacra: Creating Populated Prototypes for Social Computing Systems

Joon Sung Park, Lindsay Popowski, Carrie Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2022 · 2022

Cited alongside, same era.

ClarifyDelphi: Reinforced Clarification Questions with Defeasibility Rewards for Social and Moral Situations

Valentina Pyatkin, Jena D. Hwang, Vivek Srikumar, Ximing Lu, Liwei Jiang, Yejin Choi, and Chandra Bhagavatula. 2022 · 2022

Cited alongside, same era.

Adversarial Robustness through the Lens of Causality

Yonggang Zhang, Mingming Gong, Tongliang Liu, Gang Niu, Xinmei Tian, Bo Han, B. Schölkopf, and Kun Zhang. 2022 · 2022

Cited alongside, same era.

Probing Pre-Trained Language Models for Cross-Cultural Differences in Values

Original

Arnav Arora, Lucie-Aimée Kaffee, and Isabelle Augenstein. 2023 · 2023

Cited alongside, same era.

Assessing LLMs for Moral Value Pluralism

Noam Benkler, Drisana Mosaphir, Scott Friedman, Andrew Smart, and Sonja Schmer-Galunder. 2023 · 2023

Cited alongside, same era.

Auditing and Mitigating Cultural Bias in LLMs

Original

Yan Tao, Olga Viberg, Ryan S. Baker, and Rene F. Kizilcec. 2023 · 2023

Later among the works it cites.

Do LLMs exhibit human-like response biases? A case study in survey design

Lindia Tjuatja, Valerie Chen, Sherry Tongshuang Wu, Ameet Talwalkar, and Graham Neubig. 2023 · 2023

Later among the works it cites.

Llama 2: Open Foundation and Fine-Tuned Chat Models

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, and Thomas Scialom. 2023 · 2023

Later among the works it cites.

Jailbroken: How Does LLM Safety Training Fail?