LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions

As we may think

Vannevar Bush. 1945 · 1945

Earlier work this paper cites.

The future of interactive systems and the emergence of direct manipulation

Ben Shneiderman. 1982 · 1982

Earlier work this paper cites.

The Third-Person Effect in Communication

W. Phillips Davison. 1983 · 1983

Earlier work this paper cites.

Classic and current social comparison research: Expanding the perspective

Arie W Kruglanski and Ofra Mayseless. 1990 · 1990

Earlier work this paper cites.

Mixed-effects Models in the Study of Individual Differences with Repeated Measures Data

Robert A. Cudeck. 1996 · 1996

Earlier work this paper cites.

Using the general linear mixed model to analyse unbalanced repeated measures and longitudinal data

Avital Cnaan, Nan M. Laird, and Peter Slasor. 1997 · 1997

Earlier work this paper cites.

Direct manipulation vs. interface agents

Ben Shneiderman and Pattie Maes. 1997 · 1997

Earlier work this paper cites.

Transforming Qualitative Information: Thematic Analysis and Code Development

Richard E. Boyatzis. 1998 · 1998

Earlier work this paper cites.

Crowdsourcing user studies with Mechanical Turk. In Proceedings of the SIGCHI conference on human factors in computing systems . 453–456

Aniket Kittur, Ed H Chi, and Bongwon Suh. 2008 · 2008

Earlier work this paper cites.

Grounded theory

Lynne M. Connelly. 2013 · 2013

Earlier work this paper cites.

Disparities in publication patterns by gender, race and ethnicity based on a survey of a random sample of authors

Allison L. Hopkins, James W. Jawitz, Christopher McCarty, Alex Goldman, and Nandita B. Basu. 2013 · 2013

Earlier work this paper cites.

The future of crowd work. In Proceedings of the 2013 conference on Computer supported cooperative work . 1301–1318

Aniket Kittur, Jeffrey V Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013 · 2013

Earlier work this paper cites.

Crowdsourcing as a tool for research: Implications of uncertainty. In Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing . 1544–1561

Edith Law, Krzysztof Z Gajos, Andrea Wiggins, Mary L Gray, and Alex Williams. 2017 · 2017

Earlier work this paper cites.

The gender gap in science: How long until women are equally represented?

Luke Holman, Devi Stuart-Fox, and Cindy E. Hauser. 2018 · 2018

Earlier work this paper cites.

An Evaluation of Semantically Grouped Word Cloud Designs

Marti A. Hearst, Emily Pedersen, Lekha Priya Patil, Elsie Lee, Paul Laskowski, and Steven L. Franconeri. 2019 · 2019

Earlier work this paper cites.

Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and Symbols. In CHI

Andrew Head, Kyle Lo, Dongyeop Kang, Raymond Fok, Sam Skjonsberg, Daniel S. Weld, and Marti A. Hearst. 2021 · 2021

Earlier work this paper cites.

How weird is CHI?. In Proceedings of the 2021 chi conference on human factors in computing systems . 1–14

Sebastian Linxen, Christian Sturm, Florian Brühlmann, Vincent Cassau, Klaus Opwis, and Katharina Reinecke. 2021 · 2021

Earlier work this paper cites.

The gendered nature of authorship

Chaoqun Ni, Elise Smith, Haimiao Yuan, Vincent Larivière, and Cassidy R Sugimoto. 2021 · 2021

Earlier work this paper cites.

"An Ideal Human": Expectations of AI Teammates in Human-AI Teaming

Rui Zhang, Nathan J. McNeese, Guo Freeman, and Geoff Musick. 2021 · 2021

Earlier work this paper cites.

Sparks: Inspiration for science writing using language models. In Proceedings of the 2022 ACM Designing Interactive Systems Conference . 1002–1019

Katy Ilonka Gero, Vivian Liu, and Lydia Chilton. 2022 · 2022

Earlier work this paper cites.

Why Meta’s latest large language model survived only three days online

Will Douglas Heaven. 2022 · 2022

Earlier work this paper cites.

How Different Groups Prioritize Ethical Values for Responsible AI. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (Seoul, Republic of Korea) (FAccT ’22) . Association for Computing Machinery, New York, NY, USA, 310–323

Maurice Jakesch, Zana Buçinca, Saleema Amershi, and Alexandra Olteanu. 2022 · 2022

Earlier work this paper cites.

Will AI console me when I lose my pet? Understanding perceptions of AI-mediated email writing. In Proceedings of the 2022 CHI conference on human factors in computing systems . 1–13

Yihe Liu, Anushk Mittal, Diyi Yang, and Amy Bruckman. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Original

Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe. 2022 · 2022

Earlier work this paper cites.

Women are credited less in science than men

Matthew B Ross, Britta M Glennon, Raviv Murciano-Goroff, Enrico G Berkes, Bruce A Weinberg, and Julia I Lane. 2022 · 2022

Earlier work this paper cites.

Galactica: A Large Language Model for Science

Original

Ross Taylor, Marcin Kardas, Guillem Cucurull, Thomas Scialom, Anthony Hartshorn, Elvis Saravia, Andrew Poulton, Viktor Kerkez, and Robert Stojnic. 2022 · 2022

Earlier work this paper cites.

Expectation vs. Experience: Evaluating the Usability of Code Generation Tools Powered by Large Language Models. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22) . Association for Computing Machinery, New York, NY, USA, Article 332, 7 pages

Priyan Vaithilingam, Tianyi Zhang, and Elena L. Glassman. 2022 · 2022

Earlier work this paper cites.

Productivity assessment of neural code completion. In Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming (San Diego, CA, USA) (MAPS 2022) . Association for Computing Machinery, New York, NY, USA, 21–29

Albert Ziegler, Eirini Kalliamvakou, X. Alice Li, Andrew Rice, Devon Rifkin, Shawn Simister, Ganesh Sittampalam, and Edward Aftandilian. 2022 · 2022

Earlier work this paper cites.

Writing the rules in AI-assisted writing

2023 · 2023

Earlier work this paper cites.

ACL 2023 Policy on AI Writing Assistance

ACL. 2024 · 2023

Earlier work this paper cites.

Impact of artificial intelligence on human loss in decision making, laziness and safety in education

Sayed Fayaz Ahmad, Heesup Han, Muhammad Mansoor Alam, Mohd. Khairul Rehmat, Muhammad Irshad, Marcelo Arraño-Muñoz, and Antonio Ariza-Montes. 2023 · 2023

Earlier work this paper cites.

Artificial hallucinations in ChatGPT: implications in scientific writing

Hussam Alkaissi and Samy I McFarlane. 2023 · 2023

Earlier work this paper cites.

Paper Plain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processing

Tal August, Lucy Lu Wang, Jonathan Bragg, Marti A. Hearst, Andrew Head, and Kyle Lo. 2023 · 2023

Earlier work this paper cites.

Machine culture

Levin Brinkmann, Fabian Baumann, Jean-François Bonnefon, Maxime Derex, Thomas F. Müller, Anne-Marie Nussberger, Agnieszka Czaplicka, Alberto Acerbi, Thomas L. Griffiths, Joseph Henrich, Joel Z. Leibo, Richard McElreath, Pierre-Yves Oudeyer, Jonathan Stray, and Iyad Rahwan. 2023 · 2023

Cited alongside, same era.

Citesee: Augmenting citations in scientific papers with persistent and personalized historical context. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems . 1–15

Joseph Chee Chang, Amy X Zhang, Jonathan Bragg, Andrew Head, Kyle Lo, Doug Downey, and Daniel S Weld. 2023 · 2023

Cited alongside, same era.

Gender, Age, and Technology Education Influence the Adoption and Appropriation of LLMs

Original

Fiona Draxler, Daniel Buschek, Mikke Tavast, Perttu Hämäläinen, Albrecht Schmidt, Juhi Kulshrestha, and Robin Welsch. 2023 · 2023

Cited alongside, same era.

Friend or Foe? Exploring the Implications of Large Language Models on the Science System

Original

Benedikt Fecher, Marcel Hebing, Melissa Laufer, Jörg Pohle, and Fabian Sofsky. 2023 · 2023

Cited alongside, same era.

Marg: Multi-agent review generation for scientific papers

Original

Mike D’Arcy, Tom Hope, Larry Birnbaum, and Doug Downey. 2024 · 2024

Closest in time.

Elicit - The AI Research Assistant

Elicit. 2024 · 2024

Closest in time.

Three ways ChatGPT helps me in my academic writing

Dritjon Gruda. 2024 · 2024

Closest in time.

CHIME: LLM-Assisted Hierarchical Organization of Scientific Studies for Literature Review Support

Original

Chao-Chun Hsu, Erin Bransom, Jenna Sparks, Bailey Kuehl, Chenhao Tan, David Wadden, Lucy Lu Wang, and Aakanksha Naik. 2024 · 2024

Closest in time.

IEEE Guidelines for Generative AI Usage

IEEE. 2024 · 2024

Closest in time.

" I’m categorizing LLM as a productivity tool": Examining ethics of LLM use in HCI research practices