'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participants

Constructivist, interpretivist approaches to human inquiry

TA Schwandt. 1994 · 1994

Earlier work this paper cites.

States of Knowledge: The Co-production of Science and the Social Order

Sheila Jasanoff. 2004 · 2004

Earlier work this paper cites.

After Method: Mess in Social Science Research

J. Law. 2004 · 2004

Earlier work this paper cites.

Qualitative research : theory, method and practice

David Silverman. 2004 · 2004

Earlier work this paper cites.

Is there an epistemology for qualitative research

Mark Avis. 2005 · 2005

Earlier work this paper cites.

Epistemic injustice: Power and the ethics of knowing

Miranda Fricker. 2007 · 2007

Earlier work this paper cites.

Thick description: Toward an interpretive theory of culture

Clifford Geertz. 2008 · 2008

Earlier work this paper cites.

Autonomy and consent

Tom L Beauchamp. 2010 · 2010

Earlier work this paper cites.

Out there. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11) . Association for Computing Machinery, New York, NY, USA, 685–694

Alex S. Taylor. 2011 · 2011

Earlier work this paper cites.

Tales of the Field: On Writing Ethnography, Second Edition

J. Van Maanen. 2011 · 2011

Earlier work this paper cites.

Thematic analysis

Virginia Braun and Victoria Clarke. 2012 · 2012

Earlier work this paper cites.

Situated knowledges: The science question in feminism and the privilege of partial perspective 1

Donna Haraway. 2013 · 2013

Earlier work this paper cites.

Reflecting on the tensions between emic and etic perspectives in life history research: Lessons learned. In Forum qualitative sozialforschung/forum: qualitative social research , Vol. 15

James L Olive et al · 2014

Earlier work this paper cites.

Ways of Knowing in HCI . Vol. 2

Judith S Olson and Wendy A Kellogg. 2014 · 2014

Earlier work this paper cites.

Strangers at the Gate: Gaining Access, Building Rapport, and Co-Constructing Community-Based Research. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (Vancouver, BC, Canada) (CSCW ’15) . Association for Computing Machinery, New York, NY, USA, 1348–1358

Christopher A. Le Dantec and Sarah Fox. 2015 · 2015

Earlier work this paper cites.

Stumbling in their shoes: Disability simulations reduce judged capabilities of disabled people

Arielle M Silverman, Jason D Gwinn, and Leaf Van Boven. 2015 · 2015

Earlier work this paper cites.

Member checking: a tool to enhance trustworthiness or merely a nod to validation?

Linda Birt, Suzanne Scott, Debbie Cavers, Christine Campbell, and Fiona Walter. 2016 · 2016

Earlier work this paper cites.

Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings. In Advances in Neural Information Processing Systems , D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett (Eds.), Vol. 29. Curran Associates, Inc

Tolga Bolukbasi, Kai-Wei Chang, James Y Zou, Venkatesh Saligrama, and Adam T Kalai. 2016 · 2016

Earlier work this paper cites.

Semantics derived automatically from language corpora contain human-like biases

Aylin Caliskan, Joanna J. Bryson, and Arvind Narayanan. 2017 · 2017

Earlier work this paper cites.

New AI can guess whether you’re gay or straight from a photograph

Sam Levin. 2017 · 2017

Earlier work this paper cites.

Do Artifacts Have Politics?

Langdon Winner. 2017 · 2017

Earlier work this paper cites.

Fairness and Machine Learning Limitations and Opportunities

Solon Barocas, Moritz Hardt, and Arvind Narayanan. 2018 · 2018

Earlier work this paper cites.

“Participant” perceptions of Twitter research ethics

Casey Fiesler and Nicholas Proferes. 2018 · 2018

Earlier work this paper cites.

Surrogate humanity

Neda Atanasoski and Kalindi Vora. 2019 · 2019

Earlier work this paper cites.

The promise of empathy: Design, disability, and knowing the" other". In Proceedings of the 2019 CHI conference on human factors in computing systems . 1–13

Cynthia L Bennett and Daniela K Rosner. 2019 · 2019

Earlier work this paper cites.

Identifying and reducing gender bias in word-level language models

Original

Shikha Bordia and Samuel R Bowman. 2019 · 2019

Earlier work this paper cites.

Reflecting on reflexive thematic analysis

Virginia Braun and Victoria Clarke. 2019 · 2019

Earlier work this paper cites.

You no longer own your face

Sidney Fussell. 2019 · 2019

Earlier work this paper cites.

Reliability and inter-rater reliability in qualitative research: Norms and guidelines for CSCW and HCI practice

Nora McDonald, Sarita Schoenebeck, and Andrea Forte. 2019 · 2019

Earlier work this paper cites.

Language (Technology) is Power: A Critical Survey of “Bias” in NLP

Original

Su Lin Blodgett, Solon Barocas, Hal Daum’e, and Hanna M. Wallach. 2020 · 2020

Earlier work this paper cites.

Design justice: Community-led practices to build the worlds we need

Sasha Costanza-Chock. 2020 · 2020

Earlier work this paper cites.

UNQOVERing Stereotyping Biases via Underspecified Questions. In Findings of the Association for Computational Linguistics: EMNLP 2020 , Trevor Cohn, Yulan He, and Yang Liu (Eds.). Association for Computational Linguistics, Online, 3475–3489

Tao Li, Daniel Khashabi, Tushar Khot, Ashish Sabharwal, and Vivek Srikumar. 2020 · 2020

Earlier work this paper cites.

StereoSet: Measuring stereotypical bias in pretrained language models

Original

Moin Nadeem, Anna Bethke, and Siva Reddy. 2020 · 2020

Earlier work this paper cites.

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020 · 2020

Earlier work this paper cites.

Nothing about us without us: Investigating the role of critical disability studies in HCI. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems . 1–8

Katta Spiel, Kathrin Gerling, Cynthia L Bennett, Emeline Brulé, Rua M Williams, Jennifer Rode, and Jennifer Mankoff. 2020 · 2020

Earlier work this paper cites.

“But the data is already public”: on the ethics of research in Facebook

Michael Zimmer. 2020 · 2020

Earlier work this paper cites.

Persistent anti-muslim bias in large language models. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society . 298–306

Abubakar Abid, Maheen Farooqi, and James Zou. 2021 · 2021

Earlier work this paper cites.

On the dangers of stochastic parrots: Can language models be too big?. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency . 610–623

Emily M Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021 · 2021

Earlier work this paper cites.

Putting tools in their place: The role of time and perspective in human-AI collaboration for qualitative analysis

Jessica L Feuston and Jed R Brubaker. 2021 · 2021

Earlier work this paper cites.

Towards understanding and mitigating social biases in language models. In International Conference on Machine Learning . PMLR, 6565–6576

Paul Pu Liang, Chiyu Wu, Louis-Philippe Morency, and Ruslan Salakhutdinov. 2021 · 2021

Earlier work this paper cites.

“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI

Nithya Sambasivan, Shivani Kapania, Hannah Highfill, Diana Akrong, Praveen K. Paritosh, and Lora Aroyo. 2021 · 2021

Earlier work this paper cites.

Constitutional ai: Harmlessness from ai feedback

Original

Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, et al · 2022

Cited alongside, same era.

“This isn’t your data, friend”: Black Twitter as a case study on research ethics for public data

Shamika Klassen and Casey Fiesler. 2022 · 2022

Cited alongside, same era.

The Data-Production Dispositif

Milagros Miceli and Julian Posada. 2022 · 2022

Cited alongside, same era.

Social Simulacra: Creating Populated Prototypes for Social Computing Systems. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22) . Association for Computing Machinery, New York, NY, USA, Article 74, 18 pages

Joon Sung Park, Lindsay Popowski, Carrie Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2022 · 2022

Cited alongside, same era.

Discovering language model behaviors with model-written evaluations

How far are we from believable AI agents? A framework for evaluating the believability of human behavior simulation

Original

Yang Xiao, Yi Cheng, Jinlan Fu, Jiashuo Wang, Wenjie Li, and Pengfei Liu. 2023a · 2023

Later among the works it cites.

Visar: A human-ai argumentative writing assistant with visual programming and rapid draft prototyping. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology . 1–30

Zheng Zhang, Jie Gao, Ranjodh Singh Dhaliwal, and Toby Jia-Jun Li. 2023 · 2023

Later among the works it cites.

Sotopia: Interactive evaluation for social intelligence in language agents

Original

Xuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang, Haofei Yu, Zhengyang Qi, Louis-Philippe Morency, Yonatan Bisk, Daniel Fried, Graham Neubig, et al · 2023

Later among the works it cites.

OpenAI and journalism | OpenAI

[n. d.] · 2024

Closest in time.

The illusion of artificial inclusion. In Proceedings of the CHI Conference on Human Factors in Computing Systems . 1–12