Fetching the paper…
Reading the bibliography…
Pre-training and fine-tuning have achieved remarkable success in many downstream natural language processing (NLP) tasks.
Probabilistic models of information retrieval based on measuring the divergence from randomness
G. Amati and C. Rijsbergen. 2002 · 2002
Earlier work this paper cites.
Overview of the TREC 2004 Terabyte Track. In TREC
C. Clarke, Nick Craswell, and I. Soboroff. 2004 · 2004
Earlier work this paper cites.
Overview of the TREC 2004 Robust Track
E. Voorhees. 2004 · 2004
Earlier work this paper cites.
Building Simulated Queries for Known-Item Topics: An Analysis Using Six European Languages. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval . ACM, New York, NY, USA, 455–462
Leif Azzopardi, Maarten de Rijke, and Krisztian Balog. 2007 · 2007
Earlier work this paper cites.
A Study of Query Length. In Proceedings of the 31th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval . ACM, New York, NY, USA, 811–812
Avi Arampatzis and Jaap Kamps. 2008 · 2008
Earlier work this paper cites.
Statistical Language Models for Information Retrieval: A Critical Review
ChengXiang Zhai. 2008 · 2008
Earlier work this paper cites.
Overview of the TREC 2009 Web Track. In TREC
C. Clarke, Nick Craswell, and I. Soboroff. 2009 · 2009
Earlier work this paper cites.
The Probabilistic Relevance Framework: BM25 and Beyond
S. Robertson and H. Zaragoza. 2009 · 2009
Earlier work this paper cites.
Introducing LETOR 4.0 Datasets
T. Qin and T. Liu. 2013 · 2013
Earlier work this paper cites.
Adam: A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings , Yoshua Bengio and Yann LeCun (Eds.)
Diederik P. Kingma and Jimmy Ba. 2015 · 2015
Earlier work this paper cites.
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Daniel Fernando Campos, T. Nguyen, M. Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, L. Deng, and Bhaskar Mitra. 2016 · 2016
Earlier work this paper cites.
A Deep Relevance Matching Model for Ad-hoc Retrieval
J. Guo, Y. Fan, Qingyao Ai, and W. Croft. 2016 · 2016
Earlier work this paper cites.
Neural Architectures for Named Entity Recognition. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies . Association for Computational Linguistics, San Diego, California, 260–270
Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, and Chris Dyer. 2016 · 2016
Earlier work this paper cites.
SQuAD: 100, 000+ Questions for Machine Comprehension of Text. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing
Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016
Cited alongside, same era.
DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrieval
Liang Pang, Yanyan Lan, J. Guo, Jun Xu, J. Xu, and X. Cheng. 2017 · 2017
Cited alongside, same era.
Attention is All You Need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (Long Beach, California, USA). Curran Associates Inc., Red Hook, NY, USA, 6000–6010
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, undefinedukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Cited alongside, same era.
Convolutional Neural Networks for Soft-Matching N-Grams in Ad-hoc Search
Zhuyun Dai, Chenyan Xiong, J. Callan, and Zhiyuan Liu. 2018 · 2018
Cited alongside, same era.
Modeling Diverse Relevance Patterns in Ad-hoc Retrieval
Document Expansion by Query Prediction
Rodrigo Nogueira, Wei Yang, Jimmy Lin, and Kyunghyun Cho. 2019 · 2019
Later among the works it cites.
Simple Applications of BERT for Ad Hoc Document Retrieval
Wei Yang, Haotian Zhang, and Jimmy Lin. 2019b · 2019
Later among the works it cites.
Language Models are Few-Shot Learners
T. Brown and B. Mann et.al. 2020 · 2020
Later among the works it cites.
Overview of the TREC 2019 deep learning track
Nick Craswell, Bhaskar Mitra, E. Yilmaz, Daniel Fernando Campos, and E. Voorhees. 2020 · 2020
Later among the works it cites.
Span Selection Pre-training for Question Answering
M. Glaß, A. Gliozzo, Rishav Chakravarti, Anthony Ferritto, Lin Pan, G P Shrivatsa Bhargav, Dinesh Garg, and A. Sil. 2020 · 2020
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Y. Fan, J. Guo, Yanyan Lan, J. Xu, ChengXiang Zhai, and X. Cheng. 2018 · 2018
Cited alongside, same era.
Deep Contextualized Word Representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) . Association for Computational Linguistics, New Orleans, Louisiana, 2227–2237
Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018 · 2018
Cited alongside, same era.
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding. In BlackboxNLP@EMNLP
Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R. Bowman. 2018 · 2018
Cited alongside, same era.
Pre-training Tasks for Embedding-based Large-scale Retrieval
Wei-Cheng Chang, F. Yu, Yin-Wen Chang, Yiming Yang, and S. Kumar. 2019 · 2019
Cited alongside, same era.
Deeper Text Understanding for IR with Contextual Neural Language Modeling
Zhuyun Dai and J. Callan. 2019 · 2019
Cited alongside, same era.
Bert: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies . The 58th Annual Meeting of the Association for Computational Linguistics, Stroudsburg, PA, USA, 4171–4186
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Latent Retrieval for Weakly Supervised Open Domain Question Answering. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics . Association for Computational Linguistics, Florence, Italy, 6086–6096
Kenton Lee, Ming-Wei Chang, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
CEDR: Contextualized Embeddings for Document Ranking
Sean MacAvaney, Andrew Yates, Arman Cohan, and Nazli Goharian. 2019 · 2019
Cited alongside, same era.
Later among the works it cites.
SentiLARE: Sentiment-Aware Language Representation Learning with Linguistic Knowledge. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing
Pei Ke, Haozhe Ji, Siyang Liu, X. Zhu, and Minlie Huang. 2020 · 2020
Later among the works it cites.
Pretrained Transformers for Text Ranking: BERT and Beyond
Jimmy Lin, Rodrigo Nogueira, and A. Yates. 2020 · 2020
Later among the works it cites.
PROP: Pre-training with Representative Words Prediction for Ad-hoc Retrieval
Xinyu Ma, Jiafeng Guo, Ruqing Zhang, Yixing Fan, Xiang Ji, and Xueqi Cheng. 2020 · 2020
Later among the works it cites.
Document Ranking with a Pretrained Sequence-to-Sequence Model. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing
Rodrigo Nogueira, Zhiying Jiang, and Jimmy Lin. 2020 · 2020
Later among the works it cites.
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, M. Matena, Yanqi Zhou, W. Li, and Peter J. Liu. 2020 · 2020
Later among the works it cites.
Jingqing Zhang, Yao Zhao, Mohammad Saleh, and Peter Liu. 2020 · 2020
Later among the works it cites.
A Linguistic Study on Relevance Modeling in Information Retrieval. In Proceedings of the Web Conference 2021 . ACM
Yixing Fan, Jiafeng Guo, Xinyu Ma, Ruqing Zhang, Yanyan Lan, and Xueqi Cheng. 2021 · 2021
Closest in time.