Positional Bias in Long-Document Ranking: Impact, Assessment, and Mitigation

Passage re-ranking with BERT

Original

Rodrigo Nogueira and Kyunghyun Cho. 2019 · 1901

Earlier work this paper cites.

Document expansion by query prediction

Original

Rodrigo Nogueira, Wei Yang, Jimmy Lin, and Kyunghyun Cho. 2019 · 1904

Earlier work this paper cites.

Roberta: A robustly optimized BERT pretraining approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Huggingface’s transformers: State-of-the-art natural language processing

Original

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander M. Rush. 2019 · 1910

Earlier work this paper cites.

The mathematics of statistical machine translation: Parameter estimation

Peter F. Brown, Stephen Della Pietra, Vincent J. Della Pietra, and Robert L. Mercer. 1993 · 1993

Earlier work this paper cites.

Information retrieval as statistical translation

Adam Berger and John Lafferty. 1999 · 1999

Earlier work this paper cites.

Cumulated gain-based evaluation of IR techniques

Kalervo Järvelin and Jaana Kekäläinen. 2002 · 2002

Earlier work this paper cites.

Overview of the TREC 2019 deep learning track

Original

Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, and Ellen M. Voorhees. 2020 · 2003

Earlier work this paper cites.

Longformer: The long-document transformer

Original

Iz Beltagy, Matthew E. Peters, and Arman Cohan. 2020 · 2004

Earlier work this paper cites.

Overview of the TREC 2004 terabyte track

Charles L. A. Clarke, Nick Craswell, and Ian Soboroff. 2004 · 2004

Earlier work this paper cites.

Umass at TREC 2004: Novelty and HARD

Nasreen Abdul Jaleel, James Allan, W. Bruce Croft, Fernando Diaz, Leah S. Larkey, Xiaoyan Li, Mark D. Smucker, and Courtney Wade. 2004 · 2004

Earlier work this paper cites.

Understanding inverse document frequency: on theoretical arguments for IDF

Stephen Robertson. 2004 · 2004

Earlier work this paper cites.

Overview of the trec 2004 robust retrieval track

Ellen Voorhees. 2004 · 2004

Earlier work this paper cites.

On the stability of fine-tuning BERT: misconceptions, explanations, and strong baselines

Original

Marius Mosbach, Maksym Andriushchenko, and Dietrich Klakow. 2020 · 2006

Earlier work this paper cites.

Argumentative feedback: A linguistically-motivated term expansion for information retrieval

Patrick Ruch, Imad Tbahriti, Julien Gobeill, and Alan R. Aronson. 2006 · 2006

Earlier work this paper cites.

Million query track 2008 overview

James Allan, Javed A. Aslam, Virgil Pavlu, Evangelos Kanoulas, and Ben Carterette. 2008 · 2008

Earlier work this paper cites.

Efficient transformers: A survey

Original

Yi Tay, Mostafa Dehghani, Dara Bahri, and Donald Metzler. 2020 · 2009

Earlier work this paper cites.

Natural language processing (almost) from scratch

Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011 · 2011

Earlier work this paper cites.

Engineering efficient and effective non-metric space library

Leonid Boytsov and Bilegsaikhan Naidan. 2013 · 2013

Earlier work this paper cites.

TREC 2013 web track overview

Kevyn Collins-Thompson, Paul N. Bennett, Fernando Diaz, Charlie Clarke, and Ellen M. Voorhees. 2013a · 2013

Earlier work this paper cites.

TREC 2013 web track overview

Kevyn Collins-Thompson, Paul N. Bennett, Fernando Diaz, Charlie Clarke, and Ellen M. Voorhees. 2013b · 2013

Earlier work this paper cites.

Distributed representations of words and phrases and their compositionality

Tomas Mikolov, Ilya Sutskever, Kai Chen, Gregory S. Corrado, and Jeffrey Dean. 2013 · 2013

Earlier work this paper cites.

A comparison of retrieval models using term dependencies

Samuel Huston and W Bruce Croft. 2014 · 2014

Earlier work this paper cites.

Neural machine translation by jointly learning to align and translate

Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015 · 2015

Earlier work this paper cites.

MS MARCO: A human generated machine reading comprehension dataset

Original

Payal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Majumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, et al. 2016 · 2016

Earlier work this paper cites.

A full-text learning to rank dataset for medical information retrieval

Vera Boteva, Demian Gholipour, Artem Sokolov, and Stefan Riezler. 2016 · 2016

Earlier work this paper cites.

A deep relevance matching model for ad-hoc retrieval

Jiafeng Guo, Yixing Fan, Qingyao Ai, and W. Bruce Croft. 2016 · 2016

Earlier work this paper cites.

Google’s neural machine translation system: Bridging the gap between human and machine translation

Original

Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Lukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, and Jeffrey Dean. 2016 · 2016

Earlier work this paper cites.

Dbpedia-entity v2: A test collection for entity search

Faegheh Hasibi, Fedor Nikolaev, Chenyan Xiong, Krisztian Balog, Svein Erik Bratsberg, Alexander Kotov, and Jamie Callan. 2017 · 2017

Earlier work this paper cites.

Decoupled weight decay regularization

Original

Ilya Loshchilov and Frank Hutter. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

End-to-end neural ad-hoc ranking with kernel pooling

Chenyan Xiong, Zhuyun Dai, Jamie Callan, Zhiyuan Liu, and Russell Power. 2017 · 2017

Earlier work this paper cites.

Co-pacrr: A context-aware neural IR model for ad-hoc retrieval

Kai Hui, Andrew Yates, Klaus Berberich, and Gerard de Melo. 2018 · 2018

Earlier work this paper cites.

Deep contextualized word representations

Matthew E Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018 · 2018

Cited alongside, same era.

The annotated transformer

Alexander M Rush. 2018 · 2018

Cited alongside, same era.

Deeper text understanding for IR with contextual neural language modeling

Zhuyun Dai and Jamie Callan. 2019 · 2019

Cited alongside, same era.

BERT: pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Cited alongside, same era.

A deep look into neural ranking models for information retrieval

Jiafeng Guo, Yixing Fan, Liang Pang, Liu Yang, Qingyao Ai, Hamed Zamani, Chen Wu, W Bruce Croft, and Xueqi Cheng. 2019 · 2019

Cited alongside, same era.

Natural questions: a benchmark for question answering research

Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur P. Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019 · 2019

Understanding performance of long-document ranking models through comprehensive evaluation and leaderboarding

Original

Leonid Boytsov, Tianyi Lin, Fangwei Gao, Yutian Zhao, Jeffrey Huang, and Eric Nyberg. 2022 · 2022

Closest in time.

Overview of the TREC 2022 deep learning track

Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Jimmy Lin, Ellen M. Voorhees, and Ian Soboroff. 2022 · 2022

Closest in time.

Flashattention: Fast and memory-efficient exact attention with io-awareness

Tri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra, and Christopher Ré. 2022 · 2022

Closest in time.

Leveraging multi-view inter-passage interactions for neural document ranking

Chengzhen Fu, Enrui Hu, Letian Feng, Zhicheng Dou, Yantao Jia, Lei Chen, Fan Yu, and Zhao Cao. 2022 · 2022

Closest in time.

Long document re-ranking with modular re-ranker

Luyu Gao and Jamie Callan. 2022 · 2022

Closest in time.