Significant Improvements over the State of the Art? A Case Study of the MS MARCO Document Ranking Leaderboard

Expected Search Length: A Single Measure of Retrieval Effectiveness Based on the Weak Ordering Action of Retrieval Systems

William S. Cooper. 1968 · 1968

Earlier work this paper cites.

Cumulative Gain-Based Evaluation of IR Techniques

Kalervo Järvelin and Jaana Kekäläinen. 2002 · 2002

Earlier work this paper cites.

Accurately Interpreting Clickthrough Data as Implicit Feedback. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2005) . Salvador, Brazil, 154–161

Thorsten Joachims, Laura Granka, Bing Pang, Helene Hembrooke, and Geri Gay. 2005 · 2005

Earlier work this paper cites.

Learning User Interaction Models for Predicting Web Search Result Preferences. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2006) . Seattle, Washington, 3–10

Eugene Agichtein, Eric Brill, Susan Dumais, and Robert Ragno. 2006 · 2006

Earlier work this paper cites.

Rank-Biased Precision for Measurement of Retrieval Effectiveness

Alistair Moffat and Justin Zobel. 2008 · 2008

Cited alongside, same era.

Time-Based Calibration of Effectiveness Measures. In Proceedings of the 35th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2012) . Portland, Oregon, 95–104

Mark D. Smucker and Charles L. A. Clarke. 2012 · 2012

Cited alongside, same era.

MS MARCO: A Human Generated MAchine Reading COmprehension Dataset

Original

Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, and Li Deng. 2016 · 2016

Cited alongside, same era.

Are IR Evaluation Measures on an Interval Scale?. In Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval . 67–74

Marco Ferrante, Nicola Ferro, and Silvia Pontarollo. 2017 · 2017

Later among the works it cites.

On Fuhr’s Guideline for IR Evaluation. In SIGIR Forum , Vol. 54. p14

Tetsuya Sakai. 2020 · 2020

Later among the works it cites.

Towards Meaningful Statements in IR Evaluation. Mapping Evaluation Measures to Interval Scales

Original

Marco Ferrante, Nicola Ferro, and Norbert Fuhr. 2021 · 2021

Closest in time.