Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinions

A catalog of biases in questionnaires

Bernard CK Choi and Anita WP Pak. 2004 · 2004

Earlier work this paper cites.

Selection bias in web surveys

Jelke Bethlehem. 2010 · 2010

Earlier work this paper cites.

A statistical convergence perspective of algorithms for rank aggregation from pairwise data

Arun Rajkumar and Shivani Agarwal. 2014 · 2014

Earlier work this paper cites.

Decoupled weight decay regularization

Original

I Loshchilov. 2017 · 2017

Earlier work this paper cites.

For weighting online opt-in samples, what matters most?

Andrew Mercer, Arnold Lau, and Courtney Kennedy. 2018 · 2018

Earlier work this paper cites.

Group preference optimization: Few-shot alignment of large language models

Original

Siyan Zhao, John Dang, and Aditya Grover. 2023 · 2018

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Original

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Earlier work this paper cites.

Language models (mostly) know what they know

Original

Saurav Kadavath, Tom Conerly, Amanda Askell, Tom Henighan, Dawn Drain, Ethan Perez, Nicholas Schiefer, Zac Hatfield-Dodds, Nova DasSarma, Eli Tran-Johnson, et al. 2022 · 2022

Earlier work this paper cites.

Teaching models to express their uncertainty in words

Original

Stephanie Lin, Jacob Hilton, and Owain Evans. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022 · 2022

Earlier work this paper cites.

Moral mimicry: Large language models produce moral rationalizations tailored to political identity

Original

Gabriel Simmons. 2022 · 2022

Earlier work this paper cites.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023 · 2023

Earlier work this paper cites.

Out of one, many: Using language models to simulate human samples

Lisa P Argyle, Ethan C Busby, Nancy Fulda, Joshua R Gubler, Christopher Rytting, and David Wingate. 2023 · 2023

Earlier work this paper cites.

Can large language models be an alternative to human evaluations?

Original

Cheng-Han Chiang and Hung-yi Lee. 2023 · 2023

Earlier work this paper cites.

Language models trained on media diets can predict public opinion

Original

Eric Chu, Jacob Andreas, Stephen Ansolabehere, and Deb Roy. 2023 · 2023

Earlier work this paper cites.

Toxicity in chatgpt: Analyzing persona-assigned language models

Original

Ameet Deshpande, Vishvak Murahari, Tanmay Rajpurohit, Ashwin Kalyan, and Karthik Narasimhan. 2023 · 2023

Earlier work this paper cites.

Questioning the survey responses of large language models

Original

Ricardo Dominguez-Olmedo, Moritz Hardt, and Celestine Mendler-Dünner. 2023 · 2023

Earlier work this paper cites.

Towards measuring the representation of subjective global opinions in language models

Original

Esin Durmus, Karina Nyugen, Thomas I Liao, Nicholas Schiefer, Amanda Askell, Anton Bakhtin, Carol Chen, Zac Hatfield-Dodds, Danny Hernandez, Nicholas Joseph, et al. 2023 · 2023

Earlier work this paper cites.

From pretraining data to language models to downstream tasks: Tracking the trails of political biases leading to unfair nlp models

Original

Shangbin Feng, Chan Young Park, Yuhan Liu, and Yulia Tsvetkov. 2023 · 2023

Earlier work this paper cites.

Evaluating large language models in generating synthetic hci research data: a case study

Perttu Hämäläinen, Mikke Tavast, and Anton Kunnari. 2023 · 2023

Earlier work this paper cites.

Aligning language models to user opinions

Original

EunJeong Hwang, Bodhisattwa Prasad Majumder, and Niket Tandon. 2023 · 2023

Cited alongside, same era.

Mistral 7b

Original

Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al. 2023 · 2023

Cited alongside, same era.

Ai-augmented surveys: Leveraging large language models and surveys for opinion prediction

Original

Junsol Kim and Byungkyu Lee. 2023 · 2023

Cited alongside, same era.

Efficient memory management for large language model serving with pagedattention

Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph E. Gonzalez, Hao Zhang, and Ion Stoica. 2023 · 2023

Cited alongside, same era.

On the steerability of large language models toward data-driven personas

Few-shot personalization of llms with mis-aligned responses

Original

Jaehyung Kim and Yiming Yang. 2024 · 2024

Later among the works it cites.

The prism alignment project: What participatory, representative and individualised human feedback reveals about the subjective and multicultural alignment of large language models

Original

Hannah Rose Kirk, Alexander Whitefield, Paul Röttger, Andrew Bean, Katerina Margatina, Juan Ciro, Rafael Mosquera, Max Bartolo, Adina Williams, He He, et al. 2024 · 2024

Later among the works it cites.

From distributional to overton pluralism: Investigating large language model alignment

Original

Thom Lake, Eunsol Choi, and Greg Durrett. 2024 · 2024

Later among the works it cites.

Culturellm: Incorporating cultural differences into large language models

Original

Cheng Li, Mengzhou Chen, Jindong Wang, Sunayana Sitaram, and Xing Xie. 2024 · 2024

Later among the works it cites.