AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark

Large language models can accurately predict searcher preferences

Paul Thomas, Seth Spielman, Nick Craswell, and Bhaskar Mitra. 2024 · 1940

Earlier work this paper cites.

Www’18 open challenge: financial opinion mining and question answering

Macedo Maia, Siegfried Handschuh, André Freitas, Brian Davis, Ross McDermott, Manel Zarrouk, and Alexandra Balahur. 2018 · 1942

Earlier work this paper cites.

The proof and measurement of association between two things

Charles Spearman. 1961 · 1961

Earlier work this paper cites.

Reuters-21578 Text Categorization Collection

David Lewis. 1997 · 1997

Earlier work this paper cites.

The trec-8 question answering track report

Ellen M Voorhees et al. 1999 · 1999

Earlier work this paper cites.

The probabilistic relevance framework: Bm25 and beyond

Stephen Robertson and Hugo Zaragoza. 2009 · 2009

Earlier work this paper cites.

Ms marco: A human generated machine reading comprehension dataset

Original

Payal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Majumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, et al. 2016 · 2016

Earlier work this paper cites.

news-please: A generic news crawler and extractor

Felix Hamborg, Norman Meuschke, Corinna Breitinger, and Bela Gipp. 2017 · 2017

Earlier work this paper cites.

A discourse-aware attention model for abstractive summarization of long documents

Arman Cohan, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Seokhwan Kim, Walter Chang, and Nazli Goharian. 2018 · 2018

Earlier work this paper cites.

Multi-scale attentive interaction networks for chinese medical question answer selection

Sheng Zhang, Xin Zhang, Hui Wang, Lixiang Guo, and Shanshan Liu. 2018 · 2018

Earlier work this paper cites.

CoFiF: A corpus of financial reports in French language

Tobias Daudert and Sina Ahmadi. 2019 · 2019

Earlier work this paper cites.

Pubmedqa: A dataset for biomedical research question answering

Qiao Jin, Bhuwan Dhingra, Zhengping Liu, William Cohen, and Xinghua Lu. 2019 · 2019

Earlier work this paper cites.

Natural questions: a benchmark for question answering research

Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, et al. 2019 · 2019

Earlier work this paper cites.

Sentence-bert: Sentence embeddings using siamese bert-networks

Original

Nils Reimers and Iryna Gurevych. 2019 · 2019

Earlier work this paper cites.

Multilingual medical corpora

Fabián Villena. 2019 · 2019

Earlier work this paper cites.

Retrieval-augmented generation for knowledge-intensive nlp tasks

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2020 · 2020

Earlier work this paper cites.

Exploring the limits of transfer learning with a unified text-to-text transformer

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020 · 2020

Earlier work this paper cites.

MLSUM: The multilingual summarization corpus

Thomas Scialom, Paul-Alexis Dray, Sylvain Lamprier, Benjamin Piwowarski, and Jacopo Staiano. 2020 · 2020

Earlier work this paper cites.

Transformers: State-of-the-art natural language processing

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander M. Rush. 2020 · 2020

Cited alongside, same era.

mmarco: A multilingual version of ms marco passage ranking dataset. corr abs/2108.13897 (2021)

Original

Luiz Henrique Bonifacio, Israel Campiotti, Roberto de Alencar Lotufo, and Rodrigo Nogueira. 2021 · 2021

Cited alongside, same era.

Towards intelligent legal advisors for document retrieval and question-answering in german legal documents

Christoph Hoppe, David Pelkmann, Nico Migenda, Daniel Hötte, and Wolfram Schenck. 2021 · 2021

Cited alongside, same era.

Unsupervised dense information retrieval with contrastive learning

Original

Gautier Izacard, Mathilde Caron, Lucas Hosseini, Sebastian Riedel, Piotr Bojanowski, Armand Joulin, and Edouard Grave. 2021 · 2021

Cited alongside, same era.

Bcembedding: Bilingual and crosslingual embedding for rag

Inc. NetEase Youdao. 2023 · 2023

Later among the works it cites.

Multilegalpile: A 689gb multilingual legal corpus

Original

Joel Niklaus, Veton Matoshi, Matthias Stürmer, Ilias Chalkidis, and Daniel E. Ho. 2023 · 2023

Later among the works it cites.

Improving text embeddings with large language models

Original

Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, and Furu Wei. 2023 · 2023

Later among the works it cites.

Miracl: A multilingual retrieval dataset covering 18 diverse languages

Xinyu Zhang, Nandan Thakur, Odunayo Ogundepo, Ehsan Kamalloo, David Alfonso-Hermelo, Xiaoguang Li, Qun Liu, Mehdi Rezagholizadeh, and Jimmy Lin. 2023 · 2023

Later among the works it cites.

M3-embedding: Multi-linguality, multi-functionality, multi-granularity text embeddings through self-knowledge distillation

Jianlyu Chen, Shitao Xiao, Peitian Zhang, Kun Luo, Defu Lian, and Zheng Liu. 2024b · 2024