Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLP

Multi-news: a large-scale multi-document summarization dataset and abstractive hierarchical model

Original

Alexander R. Fabbri, Irene Li, Tianwei She, Suyi Li, and Dragomir R. Radev. 2019 · 1906

Earlier work this paper cites.

Compressive transformers for long-range sequence modelling

Original

Jack W. Rae, Anna Potapenko, Siddhant M. Jayakumar, and Timothy P. Lillicrap. 2019 · 1911

Earlier work this paper cites.

ContractNLI: A dataset for document-level natural language inference for contracts

Yuta Koreeda and Christopher Manning. 2021a · 1919

Earlier work this paper cites.

OpenAsp: A benchmark for multi-document open aspect-based summarization

Shmuel Amar, Liat Schiff, Ori Ernst, Asi Shefer, Ori Shapira, and Ido Dagan. 2023 · 1991

Earlier work this paper cites.

Aquamuse: Automatically generating datasets for query-based multi-document summarization

Original

Sayali Kulkarni, Sheide Chammas, Wan Zhu, Fei Sha, and Eugene Ie. 2020 · 2010

Earlier work this paper cites.

Long range arena: A benchmark for efficient transformers

Original

Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, and Donald Metzler. 2020 · 2011

Earlier work this paper cites.

Towards machine comprehension of spoken content: Initial toefl listening comprehension test by machine

Bo-Hsiang Tseng, Sheng-Syun Shen, Hung-Yi Lee, and Lin-Shan Lee. 2016 · 2016

Earlier work this paper cites.

Searchqa: A new q&a dataset augmented with context from a search engine

Original

Matthew Dunn, Levent Sagun, Mike Higgins, V Ugur Guney, Volkan Cirik, and Kyunghyun Cho. 2017 · 2017

Earlier work this paper cites.

The narrativeqa reading comprehension challenge

Original

Tomáš Kočiský, Jonathan Schwarz, Phil Blunsom, Chris Dyer, Karl Moritz Hermann, Gábor Melis, and Edward Grefenstette. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam M. Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

A discourse-aware attention model for abstractive summarization of long documents

Original

Arman Cohan, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Seokhwan Kim, Walter Chang, and Nazli Goharian. 2018 · 2018

Earlier work this paper cites.

The NarrativeQA Reading Comprehension Challenge

Tomáš Kočiský, Jonathan Schwarz, Phil Blunsom, Chris Dyer, Karl Moritz Hermann, Gábor Melis, and Edward Grefenstette. 2018 · 2018

Earlier work this paper cites.

Don’t give me the details, just the summary! topic-aware convolutional neural networks for extreme summarization

Shashi Narayan, Shay B. Cohen, and Mirella Lapata. 2018 · 2018

Earlier work this paper cites.

A broad-coverage challenge corpus for sentence understanding through inference

Adina Williams, Nikita Nangia, and Samuel Bowman. 2018 · 2018

Earlier work this paper cites.

Hotpotqa: A dataset for diverse, explainable multi-hop question answering

Original

Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William W. Cohen, Ruslan Salakhutdinov, and Christopher D. Manning. 2018 · 2018

Earlier work this paper cites.

BERT: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Earlier work this paper cites.

BillSum: A corpus for automatic summarization of US legislation

Anastassia Kornilova and Vladimir Eidelman. 2019 · 2019

Earlier work this paper cites.

Natural questions: A benchmark for question answering research

Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019 · 2019

Earlier work this paper cites.

BIGPATENT: A large-scale dataset for abstractive and coherent summarization

Eva Sharma, Chen Li, and Lu Wang. 2019 · 2019

Earlier work this paper cites.

To test machine comprehension, start by defining comprehension

Jesse Dunietz, Greg Burnham, Akash Bharadwaj, Owen Rambow, Jennifer Chu-Carroll, and Dave Ferrucci. 2020 · 2020

Earlier work this paper cites.

Constructing a multi-hop QA dataset for comprehensive evaluation of reasoning steps

Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, and Akiko Aizawa. 2020 · 2020

Earlier work this paper cites.

Exploring the limits of transfer learning with a unified text-to-text transformer

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020 · 2020

Earlier work this paper cites.

Extractive opinion summarization in quantized transformer spaces

Stefanos Angelidis, Reinald Kim Amplayo, Yoshihiko Suhara, Xiaolan Wang, and Mirella Lapata. 2021 · 2021

Earlier work this paper cites.

Howsumm: A multi-document summarization dataset derived from wikihow articles

Original

Odellia Boni, Guy Feigenblat, Guy Lev, Michal Shmueli-Scheuer, Benjamin Sznajder, and David Konopnicki. 2021 · 2021

Earlier work this paper cites.

A dataset of information-seeking questions and answers anchored in research papers

Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan, Noah A. Smith, and Matt Gardner. 2021 · 2021

Earlier work this paper cites.

MultiDoc2Dial: Modeling dialogues grounded in multiple documents

Song Feng, Siva Sankalp Patel, Hui Wan, and Sachindra Joshi. 2021 · 2021

Earlier work this paper cites.

Cuad: An expert-annotated nlp dataset for legal contract review

Original

Dan Hendrycks, Collin Burns, Anya Chen, and Spencer Ball. 2021 · 2021

Cited alongside, same era.

Efficient attentions for long document summarization

Luyang Huang, Shuyang Cao, Nikolaus Parulian, Heng Ji, and Lu Wang. 2021a · 2021

Cited alongside, same era.

Improved biomedical entity recognition via longer context modeling

Nikolaos Stylianou, Panagiotis Kosmoliaptsis, and Ioannis Vlahavas. 2021 · 2021

Cited alongside, same era.

QMSum: A new benchmark for query-based multi-domain meeting summarization

Ming Zhong, Da Yin, Tao Yu, Ahmad Zaidi, Mutethia Mutuma, Rahul Jha, Ahmed Hassan Awadallah, Asli Celikyilmaz, Yang Liu, Xipeng Qiu, and Dragomir Radev. 2021 · 2021

Cited alongside, same era.

Klexikon: A German dataset for joint summarization and simplification

Dennis Aumiller and Michael Gertz. 2022 · 2022

Cited alongside, same era.

Landmark attention: Random-access infinite context length for transformers

Amirkeivan Mohtashami and Martin Jaggi. 2023 · 2023

Later among the works it cites.

Captain at coliee 2023: Efficient methods for legal information retrieval and entailment tasks

Original

Chau Nguyen, Phuong Nguyen, Thanh Tran, Dat Nguyen, An Trieu, Tin Pham, Anh Dang, and Le-Minh Nguyen. 2024 · 2023

Later among the works it cites.

Giraffe: Adventures in expanding context lengths in llms

Original

Arka Pal, Deep Karkhanis, Manley Roberts, Samuel Dooley, Arvind Sundararajan, and Siddartha Naidu. 2023 · 2023

Later among the works it cites.

MeetingQA: Extractive question-answering on meeting transcripts

Archiki Prasad, Trung Bui, Seunghyun Yoon, Hanieh Deilamsalehy, Franck Dernoncourt, and Mohit Bansal. 2023 · 2023

Later among the works it cites.

Webbrain: Learning to generate factually correct articles for queries by grounding on large web corpus

Original