Fetching the paper…
Reading the bibliography…
We introduce a new pretraining approach geared for multi-document language modeling, incorporating two key ideas into the masked language modeling self-supervised objective.
RoBERTa: A robustly optimized BERT pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907
Earlier work this paper cites.
A model-theoretic coreference scoring scheme
Marc Vilain, John Burger, John Aberdeen, Dennis Connolly, and Lynette Hirschman. 1995 · 1995
Earlier work this paper cites.
Algorithms for scoring coreference chains
Amit Bagga and Breck Baldwin. 1998 · 1998
Earlier work this paper cites.
Longformer: The long-document transformer
Iz Beltagy, Matthew E Peters, and Arman Cohan. 2020 · 2004
Earlier work this paper cites.
On coreference resolution performance metrics
Xiaoqiang Luo. 2005 · 2005
Earlier work this paper cites.
Streamlining cross-document coreference resolution: Evaluation and modeling
Arie Cattan, Alon Eirew, Gabriel Stanovsky, Mandar Joshi, and Ido Dagan. 2020 · 2009
Earlier work this paper cites.
Paired representation learning for event and entity coreference
Xiaodong Yu, Wenpeng Yin, and Dan Roth. 2020 · 2010
Earlier work this paper cites.
Overview of the 5th international competition on plagiarism detection
Martin Potthast, Matthias Hagen, Tim Gollub, Martin Tippmann, Johannes Kiesel, Paolo Rosso, Efstathios Stamatatos, and Benno Stein. 2013 · 2013
Earlier work this paper cites.
The ACL anthology network corpus
Dragomir R Radev, Pradeep Muthukrishnan, Vahed Qazvinian, and Amjad Abu-Jbara. 2013 · 2013
Earlier work this paper cites.
Using a sledgehammer to crack a nut? lexical diversity and event coreference resolution
Agata Cybulska and Piek Vossen. 2014 · 2014
Earlier work this paper cites.
“Bag of Events” approach to event coreference resolution. supervised classification of event templates
Agata Cybulska and Piek Vossen. 2015 · 2015
Earlier work this paper cites.
Which coreference evaluation metric do you trust? a proposal for a link-based entity aware metric
Nafise Sadat Moosavi and Michael Strube. 2016 · 2016
Earlier work this paper cites.
Hierarchical attention networks for document classification
Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, and Eduard Hovy. 2016 · 2016
Earlier work this paper cites.
End-to-end neural coreference resolution
Kenton Lee, Luheng He, Mike Lewis, and Luke Zettlemoyer. 2017 · 2017
Earlier work this paper cites.
Acquiring predicate paraphrases from news tweets
Vered Shwartz, Gabriel Stanovsky, and Ido Dagan. 2017 · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Content-based citation recommendation
Chandra Bhagavatula, Sergey Feldman, Russell Power, and Waleed Ammar. 2018 · 2018
Cited alongside, same era.
The hitchhiker’s guide to testing statistical significance in natural language processing
Rotem Dror, Gili Baumer, Segev Shlomov, and Roi Reichart. 2018 · 2018
Cited alongside, same era.
Resolving event coreference with supervised representation learning and clustering-oriented regularization
Kian Kenyon-Dean, Jackie Chi Kit Cheung, and Doina Precup. 2018 · 2018
Cited alongside, same era.
Stance detection with hierarchical attention network
Qingying Sun, Zhongqing Wang, Qiaoming Zhu, and Guodong Zhou. 2018 · 2018
Cited alongside, same era.
HotpotQA: A dataset for diverse, explainable multi-hop question answering
Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William Cohen, Ruslan Salakhutdinov, and Christopher D. Manning. 2018 · 2018
Cited alongside, same era.
Retrieval augmented language model pre-training
Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Mingwei Chang. 2020 · 2020
Later among the works it cites.
Dense passage retrieval for open-domain question answering
Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. 2020 · 2020
Later among the works it cites.
S2ORC: The semantic scholar open research corpus
Kyle Lo, Lucy Lu Wang, Mark Neumann, Rodney Kinney, and Daniel Weld. 2020 · 2020
Later among the works it cites.
Paraphrasing vs coreferring: Two sides of the same coin
Yehudit Meged, Avi Caciularu, Vered Shwartz, and Ido Dagan. 2020 · 2020
Later among the works it cites.
Exploring the limits of transfer learning with a unified text-to-text transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020 · 2020
Later among the works it cites.
Transformers: State-of-the-art natural language processing
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Shany Barhom, Vered Shwartz, Alon Eirew, Michael Bugert, Nils Reimers, and Ido Dagan. 2019 · 2019
Cited alongside, same era.
What does BERT look at? an analysis of BERT’s attention
Kevin Clark, Urvashi Khandelwal, Omer Levy, and Christopher D. Manning. 2019 · 2019
Cited alongside, same era.
Cross-lingual language model pretraining
Alexis Conneau and Guillaume Lample. 2019 · 2019
Cited alongside, same era.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019a · 2019
Cited alongside, same era.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019b · 2019
Cited alongside, same era.
Multi-news: A large-scale multi-document summarization dataset and abstractive hierarchical model
Alexander Fabbri, Irene Li, Tianwei She, Suyi Li, and Dragomir Radev. 2019 · 2019
Cited alongside, same era.
Semantic text matching for long-form documents
Jyun-Yu Jiang, Mingyang Zhang, Cheng Li, Michael Bendersky, Nadav Golbandi, and Marc Najork. 2019 · 2019
Cited alongside, same era.
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander Rush. 2020 · 2020
Later among the works it cites.
Beyond 512 tokens: Siamese multi-depth transformer-based hierarchical encoder for long-form document matching
Liu Yang, Mingyang Zhang, Cheng Li, Michael Bendersky, and Marc Najork. 2020 · 2020
Later among the works it cites.
Big Bird: Transformers for longer sequences
Manzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie, Chris Alberti, Santiago Ontanon, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, et al. 2020 · 2020
Later among the works it cites.
Event coreference resolution with their paraphrases and argument-aware embeddings
Yutao Zeng, Xiaolong Jin, Saiping Guan, Jiafeng Guo, and Xueqi Cheng. 2020 · 2020
Later among the works it cites.
Transformer-XH: Multi-evidence reasoning with extra hop attention
Chen Zhao, Chenyan Xiong, Corby Rosset, Xia Song, Paul Bennett, and Saurabh Tiwary. 2020 · 2020
Later among the works it cites.
Multilevel text alignment with cross-document attention
Xuhui Zhou, Nikolaos Pappas, and Noah A. Smith. 2020 · 2020
Later among the works it cites.
Sequential cross-document coreference resolution
Emily Allaway, Shuai Wang, and Miguel Ballesteros. 2021 · 2021
Closest in time.
Self-supervised document similarity ranking via contextualized language models and hierarchical inference
Dvir Ginzburg, Itzik Malkiel, Oren Barkan, Avi Caciularu, and Noam Koenigstein. 2021 · 2021
Closest in time.
ifacetsum: Coreference-based interactive faceted summarization for multi-document exploration
Eran Hirsch, Alon Eirew, Ori Shapira, Avi Caciularu, Arie Cattan, Ori Ernst, Ramakanth Pasunuru, Hadar Ronen, Mohit Bansal, and Ido Dagan. 2021 · 2021
Closest in time.
Long range arena: A benchmark for efficient transformers
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, and Donald Metzler. 2021 · 2021
Closest in time.