Sparse Meets Dense: A Hybrid Approach to Enhance Scientific Document Retrieval

SciBERT: A pretrained language model for scientific text,

Original

I. Beltagy, K. Lo, A. Cohan, · 1903

Earlier work this paper cites.

G. Salton, M. J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., 1983

1983

Earlier work this paper cites.

The cystic fibrosis database: Content and research opportunities,

W. Shaw, J. Wood, R. Wood, H. Tibbo, · 1991

Earlier work this paper cites.

R. Baeza-Yates, B. Ribeiro-Neto, Modern Information Retrieval, ACM Press, New York, 1999

1999

Earlier work this paper cites.

Cumulated gain-based evaluation of IR techniques,

K. Järvelin, J. Kekäläinen, · 2002

Earlier work this paper cites.

Dense passage retrieval for open-domain question answering,

Original

V. Karpukhin, B. Oguz, S. Min, L. Wu, S. Edunov, D. Chen, W. Yih, · 2004

Cited alongside, same era.

SPECTER: document-level representation learning using citation-informed transformers,

Original

A. Cohan, S. Feldman, I. Beltagy, D. Downey, D. S. Weld, · 2004

Cited alongside, same era.

C. D. Manning, P. Raghavan, H. Schütze, Introduction to Information Retrieval, Cambridge University Press, Cambridge, 2008

2008

Cited alongside, same era.

Distributed representations of sentences and documents,

Q. Le, T. Mikolov, · 2014

Cited alongside, same era.

Semantic scholar,

AI2, · 2015

Cited alongside, same era.

Attention is all you need,

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, I. Polosukhin, · 2017

Later among the works it cites.

Bert: Pre-training of deep bidirectional transformers for language understanding,

J. Devlin, M.-W. Chang, K. Lee, K. Toutanova, · 2019

Later among the works it cites.

Sparse, Dense, and Attentional Representations for Text Retrieval,

Y. Luan, J. Eisenstein, K. Toutanova, M. Collins, · 2021

Later among the works it cites.

A. Singh, M. D’Arcy, A. Cohan, D. Downey, S. Feldman, SciRepEval: A multi-format benchmark for scientific document representations, 2023. arXiv:2211.13308

Original

2023

Later among the works it cites.

Hybrid hierarchical retrieval for open-domain question answering,

M. G. Arivazhagan, L. Liu, P. Qi, X. Chen, W. Y. Wang, Z. Huang, · 2023

Later among the works it cites.