Fetching the paper…
Reading the bibliography…
This paper describes a machine learning algorithm for document (re)ranking, in which queries and documents are firstly encoded using BERT [1], and on top of that a learning-to-rank (LTR) model constructed with TF-Ranking (TFR) [2] is applied to further optimize the ranking performance.
Learning to rank for information retrieval
Tie-Yan Liu et al · 2009
Earlier work this paper cites.
Ms marco: A human generated machine reading comprehension dataset
Payal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Majumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, et al · 2016
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Earlier work this paper cites.
Tf-ranking: Scalable tensorflow library for learning-to-rank
Rama Kumar Pasumarthi, Sebastian Bruch, Xuanhui Wang, Cheng Li, Michael Bendersky, Marc Najork, Jan Pfeifer, Nadav Golbandi, Rohan Anil, and Stephan Wolf · 2019
Earlier work this paper cites.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov · 2019
Earlier work this paper cites.
Albert: A lite bert for self-supervised learning of language representations
Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut · 2019
Earlier work this paper cites.
Open domain web keyphrase extraction beyond language modeling
Lee Xiong, Chuan Hu, Chenyan Xiong, Daniel Campos, and Arnold Overwijk · 2019
Earlier work this paper cites.
Multi-stage document ranking with BERT, 2019
Rodrigo Nogueira, Wei Yang, Kyunghyun Cho, and Jimmy Lin · 2019
Cited alongside, same era.
Rodrigo Nogueira and Kyunghyun Cho · 2019
Cited alongside, same era.
Revisiting approximate metric optimization in the age of deep neural networks
Sebastian Bruch, Masrour Zoghi, Mike Bendersky, and Marc Najork · 2019
Cited alongside, same era.
Context-aware sentence/passage term importance estimation for first stage retrieval
Zhuyun Dai and Jamie Callan · 2019
Cited alongside, same era.
An updated duet model for passage re-ranking
Bhaskar Mitra and Nick Craswell · 2019
Cited alongside, same era.
Electra: Pre-training text encoders as discriminators rather than generators
Kevin Clark, Minh-Thang Luong, Quoc V Le, and Christopher D Manning · 2020
Closest in time.
Tf-ranking ensemble of bert, roberta and electra
Shuguang Han, Xuanhui Wang, Michael Bendersky, and Marc Najork · 2020
Closest in time.
Deepct + tf-ranking ensemble of bert, roberta and electra
Shuguang Han, Xuanhui Wang, Michael Bendersky, and Marc Najork · 2020
Closest in time.
Tf-ranking + bert (softmax loss, list size 6, 200k steps)
Shuguang Han, Xuanhui Wang, Michael Bendersky, and Marc Najork · 2020
Closest in time.
Enriched bert base + aoa index
Ming Yan · 2020
Closest in time.
Table model
Xinwu Sun · 2020
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Tf-ranking + bert (ensemble of pointwise, pairwise and listwise losses)
Shuguang Han, Xuanhui Wang, Michael Bendersky, and Marc Najork · 2020
Cited alongside, same era.
Deepct retrieval + tf-ranking bert ensemble
Shuguang Han, Zhuyun Dai, Xuanhui Wang, Michael Bendersky, and Marc Najork · 2020
Cited alongside, same era.