MAIR: A Massive Benchmark for Evaluating Instructed Retrieval

Passage re-ranking with bert

Original

Rodrigo Nogueira and Kyunghyun Cho. 2019 · 1901

Earlier work this paper cites.

Sparc: Cross-domain semantic parsing in context

Original

Tao Yu, Rui Zhang, Michihiro Yasunaga, Yi Chern Tan, Xi Victoria Lin, Suyi Li, He Yang Er, Irene Z Li, Bo Pang, Tao Chen, Emily Ji, Shreya Dixit, David Proctor, Sungrok Shim, Jonathan Kraft, Vincent Zhang, Caiming Xiong, Richard Socher, and Dragomir R. Radev. 2019 · 1906

Earlier work this paper cites.

Eli5: Long form question answering

Original

Angela Fan, Yacine Jernite, Ethan Perez, David Grangier, Jason Weston, and Michael Auli. 2019 · 1907

Earlier work this paper cites.

Codesearchnet challenge: Evaluating the state of semantic code search

Original

Hamel Husain, Hongqiu Wu, Tiferet Gazit, Miltiadis Allamanis, and Marc Brockschmidt. 2019 · 1909

Earlier work this paper cites.

Billsum: A corpus for automatic summarization of us legislation

Original

Anastassia Kornilova and Vladimir Eidelman. 2019 · 1910

Earlier work this paper cites.

Specter: Document-level representation learning using citation-informed transformers

Original

Arman Cohan, Sergey Feldman, Iz Beltagy, Doug Downey, and Daniel S. Weld. 2020 · 2004

Earlier work this paper cites.

Dense passage retrieval for open-domain question answering

Original

Vladimir Karpukhin, Barlas Oğuz, Sewon Min, Patrick Lewis, Ledell Yu Wu, Sergey Edunov, Danqi Chen, and Wen tau Yih. 2020 · 2004

Earlier work this paper cites.

Trec 2007 genomics track overview

William R. Hersh, Aaron M. Cohen, Jianji Yang, Ravi Teja Bhupatiraju, Phoebe M. Roberts, and Marti A. Hearst. 2007 · 2007

Earlier work this paper cites.

Robust disambiguation of named entities in text

Johannes Hoffart, Mohamed Amir Yosef, Ilaria Bordino, Hagen Fürstenau, Manfred Pinkal, Marc Spaniol, Bilyana Taneva, Stefan Thater, and Gerhard Weikum. 2011 · 2011

Earlier work this paper cites.

Cqadupstack: A benchmark data set for community question-answering research

Doris Hoogeveen, Karin M. Verspoor, and Timothy Baldwin. 2015 · 2015

Earlier work this paper cites.

A full-text learning to rank dataset for medical information retrieval

Vera Boteva, Demian Gholipour Ghalandari, Artem Sokolov, and Stefan Riezler. 2016 · 2016

Earlier work this paper cites.

Ms marco: A human generated machine reading comprehension dataset

Original

Daniel Fernando Campos, Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng, and Bhaskar Mitra. 2016 · 2016

Earlier work this paper cites.

Zero-shot relation extraction via reading comprehension

Original

Omer Levy, Minjoon Seo, Eunsol Choi, and Luke Zettlemoyer. 2017 · 2017

Earlier work this paper cites.

Wizard of wikipedia: Knowledge-powered conversational agents

Original

Emily Dinan, Stephen Roller, Kurt Shuster, Angela Fan, Michael Auli, and Jason Weston. 2018 · 2018

Earlier work this paper cites.

T-rex: A large scale alignment of natural language with knowledge base triples

Hady ElSahar, Pavlos Vougiouklis, Arslen Remaci, Christophe Gravier, Jonathon S. Hare, Frédérique Laforest, and Elena Paslaru Bontas Simperl. 2018 · 2018

Earlier work this paper cites.

Robust named entity disambiguation with random walks

Zhaochen Guo and Denilson Barbosa. 2018 · 2018

Earlier work this paper cites.

Www’18 open challenge: Financial opinion mining and question answering

Macedo Maia, Siegfried Handschuh, André Freitas, Brian Davis, Ross McDermott, Manel Zarrouk, and Alexandra Balahur. 2018 · 2018

Earlier work this paper cites.

Fever: a large-scale dataset for fact extraction and verification

Original

James Thorne, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. 2018 · 2018

Earlier work this paper cites.

Retrieval of the best counterargument without prior topic knowledge

Henning Wachsmuth, Shahbaz Syed, and Benno Stein. 2018 · 2018

Earlier work this paper cites.

Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task

Original

Tao Yu, Rui Zhang, Kai-Chou Yang, Michihiro Yasunaga, Dongxu Wang, Zifan Li, James Ma, Irene Z Li, Qingning Yao, Shanelle Roman, Zilin Zhang, and Dragomir R. Radev. 2018 · 2018

Earlier work this paper cites.

Overview of the fire 2019 aila track: Artificial intelligence for legal assistance

Paheli Bhattacharya, Kripabandhu Ghosh, Saptarshi Ghosh, Arindam Pal, Parth Mehta, Arnab Bhattacharya, and Prasenjit Majumder. 2019 · 2019

Earlier work this paper cites.

Overview of touché 2020: Argument retrieval

Alexander Bondarenko, Maik Fröbe, Meriem Beloucif, Lukas Gienapp, Yamen Ajjour, Alexander Panchenko, Christian Biemann, Benno Stein, Henning Wachsmuth, Martin Potthast, and Matthias Hagen. 2020 · 2020

Earlier work this paper cites.

Kilt: a benchmark for knowledge intensive language tasks

Fabio Petroni, Aleksandra Piktus, Angela Fan, Patrick Lewis, Majid Yazdani, Nicola De Cao, James Thorne, Yacine Jernite, Vassilis Plachouras, Tim Rocktaschel, and Sebastian Riedel. 2020 · 2020

Earlier work this paper cites.

Trec-covid: rationale and structure of an information retrieval shared task for covid-19

Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen M. Voorhees, Lucy Lu Wang, and William R. Hersh. 2020 · 2020

Earlier work this paper cites.

Fact or fiction: Verifying scientific claims

David Wadden, Kyle Lo, Lucy Lu Wang, Shanchuan Lin, Madeleine van Zuylen, Arman Cohan, and Hannaneh Hajishirzi. 2020 · 2020

Earlier work this paper cites.

Topiocqa: Open-domain conversational question answering with topic switching

Vaibhav Adlakha, Shehzaad Dhuliawala, Kaheer Suleman, Harm de Vries, and Siva Reddy. 2021 · 2021

Earlier work this paper cites.

Pointrec: A test collection for narrative-driven point of interest recommendation

Jafar Afzali, Aleksander Mark Drzewiecki, and Krisztian Balog. 2021 · 2021

Earlier work this paper cites.

Program synthesis with large language models

Original

Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie J. Cai, Michael Terry, Quoc V. Le, and Charles Sutton. 2021 · 2021

Cited alongside, same era.

Regulatory compliance through doc2doc information retrieval: A case study in eu/uk legislation where text similarity has limitations

Ilias Chalkidis, Manos Fergadiotis, Nikolaos Manginas, Eva Katakalou, and Prodromos Malakasiotis. 2021 · 2021

Cited alongside, same era.

Unsupervised corpus aware language model pre-training for dense passage retrieval

Original

Luyu Gao and Jamie Callan. 2021 · 2021

Cited alongside, same era.

Towards intelligent legal advisors for document retrieval and question-answering in german legal documents

Christoph Hoppe, David Pelkmann, Nico Migenda, Daniel Hötte, and Wolfram Schenck. 2021 · 2021

Cited alongside, same era.

A test collection for ad-hoc dataset retrieval

Swe-bench: Can language models resolve real-world github issues?

Original

Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan. 2023 · 2023

Later among the works it cites.

Repobench: Benchmarking repository-level code auto-completion systems

Original

Tianyang Liu, Canwen Xu, and Julian McAuley. 2023 · 2023

Later among the works it cites.

Octopack: Instruction tuning code large language models

Original

Niklas Muennighoff, Qian Liu, Qi Liu, Armel Zebaze, Qinkai Zheng, Binyuan Hui, Terry Yue Zhuo, Swayam Singh, Xiangru Tang, Leandro von Werra, and S. Longpre. 2023 · 2023

Later among the works it cites.

Gorilla: Large language model connected with massive apis

Original

Shishir G Patil, Tianjun Zhang, Xin Wang, and Joseph E Gonzalez. 2023 · 2023

Later among the works it cites.