Risk or Chance? Large Language Models and Reproducibility in HCI Research

The Role of HCI in Reproducible Science: Understanding, Supporting and Motivating Core Practices. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19) . Association for Computing Machinery, New York, NY, USA, 1–6

Sebastian S. Feger, Sünje Dallmeier-Tiessen, Paweł W. Woźniak, and Albrecht Schmidt. 2019 · 2019

Earlier work this paper cites.

Transparency of CHI Research Artifacts: Results of a Self-Reported Survey. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20) . Association for Computing Machinery, New York, NY, USA, 1–14

Original

Chat Wacharamanotham, Lukas Eisenring, Steve Haroz, and Florian Echtler. 2020 · 2020

Earlier work this paper cites.

Is AI fuelling a reproducibility crisis in science

Elizabeth Gibney. 2022 · 2022

Earlier work this paper cites.

Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies. In Proceedings of the 40th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 202) , Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 337–371

Gati V Aher, Rosa I. Arriaga, and Adam Tauman Kalai. 2023 · 2023

Cited alongside, same era.

Is AI leading to a reproducibility crisis in science?

Philip Ball. 2023 · 2023

Cited alongside, same era.

Using ChatGPT for human–computer interaction research: a primer

Wilbert Tabone and Joost de Winter. 2023 · 2023

Cited alongside, same era.

The illusion of artificial inclusion

Original

William Agnew, A Stevie Bergman, Jennifer Chien, Mark Díaz, Seliem El-Sayed, Jaylen Pittman, Shakir Mohamed, and Kevin R McKee. 2024 · 2024

Closest in time.

Simulating the Human in HCD with ChatGPT: Redesigning Interaction Design with AI

Albrecht Schmidt, Passant Elagroudy, Fiona Draxler, Frauke Kreuter, and Robin Welsch. 2024 · 2024

Closest in time.

AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation

Original

Orit Shaer, Angelora Cooper, Osnat Mokryn, Andrew L. Kun, and Hagit Ben Shoshan. 2024 · 2024

Closest in time.