AI Can Be Cognitively Biased: An Exploratory Study on Threshold Priming in LLM-Based Batch Relevance Assessment

Judgment under Uncertainty: Heuristics and Biases

Amos Tversky and Daniel Kahneman. 1974 · 1974

Earlier work this paper cites.

Adding Asymmetrically Dominated Alternatives: Violations of Regularity and the Similarity Hypothesis

Joel Huber, John W. Payne, and Christopher Puto. 1982 · 1982

Earlier work this paper cites.

Bias and error in human judgment

Arie W. Kruglanski and Icek Ajzen. 1983 · 1983

Earlier work this paper cites.

Cognitive biases and their impact on strategic planning

James H. Barnes JR. 1984 · 1984

Earlier work this paper cites.

Priming by pictures in lexical decision

Mary Vanderwart. 1984 · 1984

Earlier work this paper cites.

Consequences of priming: Judgment and behavior

Paul M Herr. 1986 · 1986

Earlier work this paper cites.

Priming and human memory systems

Endel Tulving and Daniel L Schacter. 1990 · 1990

Earlier work this paper cites.

Anomalies: The endowment effect, loss aversion, and status quo bias

Daniel Kahneman, Jack L Knetsch, and Richard H Thaler. 1991 · 1991

Earlier work this paper cites.

Loss Aversion in Riskless Choice: A Reference-Dependent Model

Amos Tversky and Daniel Kahneman. 1991 · 1991

Earlier work this paper cites.

Advances in prospect theory: Cumulative representation of uncertainty

Amos Tversky and Daniel Kahneman. 1992 · 1992

Earlier work this paper cites.

Overview of the TREC 2019 deep learning track

Original

Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, and Ellen M. Voorhees. 2020 · 2003

Earlier work this paper cites.

Do People Experience Cognitive Biases while Searching for Information?

Annie Y.S. Lau and Enrico W. Coiera. 2007 · 2007

Earlier work this paper cites.

Toward a synthesis of cognitive biases: how noisy information processing can bias human decision making

Martin Hilbert. 2012 · 2012

Earlier work this paper cites.

Reducing confirmation bias and evaluation bias: When are preference-inconsistent recommendations effective – and when not?

Christina Schwind and Jürgen Buder. 2012 · 2012

Earlier work this paper cites.

Consumer health information searching process in real life settings

Yan Zhang. 2012 · 2012

Earlier work this paper cites.

The Effect of Threshold Priming and Need for Cognition on Relevance Calibration and Assessment. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval (Dublin, Ireland) (SIGIR ’13) . Association for Computing Machinery, New York, NY, USA, 623–632

Falk Scholer, Diane Kelly, Wan-Ching Wu, Hanseul S. Lee, and William Webber. 2013 · 2013

Earlier work this paper cites.

Captions and biases in diagnostic search

Ryen W. White and Eric Horvitz. 2013 · 2013

Earlier work this paper cites.

Understanding and Predicting Graded Search Satisfaction. In Proceedings of the Eighth ACM International Conference on Web Search and Data Mining (Shanghai, China) (WSDM ’15) . Association for Computing Machinery, New York, NY, USA, 57–66

Jiepu Jiang, Ahmed Hassan Awadallah, Xiaolin Shi, and Ryen W. White. 2015 · 2015

Earlier work this paper cites.

Confirmation Bias in Online Searches: Impacts of Selective Exposure Before an Election on Political Attitude Strength and Shifts

Silvia Knobloch-Westerwick, Benjamin K. Johnson, and Axel Westerwick. 2015 · 2015

Earlier work this paper cites.

Anchoring and Adjustment in Relevance Estimation. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (Santiago, Chile) (SIGIR ’15) . Association for Computing Machinery, New York, NY, USA, 963–966

Milad Shokouhi, Ryen White, and Emine Yilmaz. 2015 · 2015

Earlier work this paper cites.

When does Relevance Mean Usefulness and User Satisfaction in Web Search?. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval (Pisa, Italy) (SIGIR ’16) . Association for Computing Machinery, New York, NY, USA, 463–472

Jiaxin Mao, Yiqun Liu, Ke Zhou, Jian-Yun Nie, Jingtao Song, Min Zhang, Shaoping Ma, Jiashen Sun, and Hengliang Luo. 2016 · 2016

Earlier work this paper cites.

Quantifying Search Bias: Investigating Sources of Bias for Political Searches in Social Media. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (Portland, Oregon, USA) (CSCW ’17) . Association for Computing Machinery, New York, NY, USA, 417–432

Juhi Kulshrestha, Motahhare Eslami, Johnnatan Messias, Muhammad Bilal Zafar, Saptarshi Ghosh, Krishna P. Gummadi, and Karrie Karahalios. 2017 · 2017

Earlier work this paper cites.

Scroll up or down? using wheel activity as an indicator of browsing strategy across different contextual factors. In Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval . 333–336

Chang Liu, Jiqun Liu, and Yiming Wei. 2017 · 2017

Cited alongside, same era.

Understanding and Predicting Usefulness Judgment in Web Search. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (Shinjuku, Tokyo, Japan) (SIGIR ’17) . Association for Computing Machinery, New York, NY, USA, 1169–1172

Jiaxin Mao, Yiqun Liu, Huanbo Luan, Min Zhang, Shaoping Ma, Hengliang Luo, and Yuntao Zhang. 2017 · 2017

Cited alongside, same era.

Cognitive Biases in Crowdsourcing. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining (Marina Del Rey, CA, USA) (WSDM ’18) . Association for Computing Machinery, New York, NY, USA, 162–170

Carsten Eickhoff. 2018 · 2018

Cited alongside, same era.

ChatGPT outperforms crowd workers for text-annotation tasks

Fabrizio Gilardi, Meysam Alizadeh, and Maël Kubli. 2023 · 2023

Later among the works it cites.

Instructed to Bias: Instruction-Tuned Language Models Exhibit Emergent Cognitive Bias

Original

Itay Itzhak, Gabriel Stanovsky, Nir Rosenfeld, and Yonatan Belinkov. 2023 · 2023

Later among the works it cites.

A Behavioral Economics Approach to Interactive Information Retrieval: Understanding and Supporting Boundedly Rational Users . Vol. 48

Jiqun Liu. 2023 · 2023

Later among the works it cites.

Constructing and meta-evaluating state-aware evaluation metrics for interactive search systems

Marco Markwald, Jiqun Liu, and Ran Yu. 2023 · 2023

Later among the works it cites.

Llama 2: Open Foundation and Fine-Tuned Chat Models

Original

Meta. 2023 · 2023

Later among the works it cites.