2020

MLSUM: The Multilingual Summarization Corpus

Scialom, Thomas, Dray, Paul-Alexis, Lamprier, Sylvain et al.

Understand

We present MLSUM, the first large-scale MultiLingual SUMmarization dataset.

Obtained from online newspapers, it contains 1.5M+ article/summary pairs in five different languages -- namely, French, German, Spanish, Russian, Turkish.
Together with English newspapers from the popular CNN/Daily mail dataset, the collected data form a large scale multilingual dataset which can enable new research directions for the text summarization community.
We report cross-lingual comparative analyses based on state-of-the-art systems.

Built on

Cross-lingual language model pretraining
Original
Guillaume Lample and Alexis Conneau. 2019 · 1901
Earlier work this paper cites.
Unified language model pre-training for natural language understanding and generation
Original
Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, and Hsiao-Wuen Hon. 2019 · 1905
Earlier work this paper cites.
Generating summaries with topic templates and structured convolutional decoders
Original
Laura Perez-Beltrachini, Yang Liu, and Mirella Lapata. 2019 · 1906
Earlier work this paper cites.
How multilingual is multilingual bert?
Original
Telmo Pires, Eva Schlinger, and Dan Garrette. 2019 · 1906
Earlier work this paper cites.
Bigpatent: A large-scale dataset for abstractive and coherent summarization
Original
Eva Sharma, Chen Li, and Lu Wang. 2019 · 1906
Earlier work this paper cites.
Cross-lingual natural language generation via pre-training
Original
Zewen Chi, Li Dong, Furu Wei, Wenhui Wang, Xian-Ling Mao, and Heyan Huang. 2019 · 1909
Earlier work this paper cites.
Evaluating the factual consistency of abstractive text summarization
Original
Wojciech Kryściński, Bryan McCann, Caiming Xiong, and Richard Socher. 2019 · 1910
Earlier work this paper cites.
Mlqa: Evaluating cross-lingual extractive question answering
Original
Patrick Lewis, Barlas Oğuz, Ruty Rinott, Sebastian Riedel, and Holger Schwenk. 2019 · 1910
Earlier work this paper cites.
Lcsts: A large scale chinese short text summarization dataset
Baotian Hu, Qingcai Chen, and Fangze Zhu. 2015 · 1972
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997
Earlier work this paper cites.
Byte pair encoding: A text compression scheme that accelerates pattern matching
Yusuxke Shibata, Takuya Kida, Shuichi Fukamachi, Masayuki Takeda, Ayumi Shinohara, Takeshi Shinohara, and Setsuo Arikawa. 1999 · 1999
Earlier work this paper cites.
Evaluation of text summarization in a cross-lingual information retrieval framework
Dragomir Radev, Simone Teufel, Horacio Saggion, Wai Lam, John Blitzer, Arda Celebi, Hong Qi, Elliott Drabek, and Danyu Liu. 2002 · 2002
Earlier work this paper cites.
Hedge trimmer: A parse-and-trim approach to headline generation
Bonnie Dorr, David Zajic, and Richard Schwartz. 2003 · 2003
Earlier work this paper cites.
The effects of human variation in duc summarization evaluation
Donna Harman and Paul Over. 2004 · 2004
Earlier work this paper cites.
Xglue: A new benchmark dataset for cross-lingual pre-training, understanding and generation
Original
Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, et al. 2020 · 2004
Earlier work this paper cites.
Rouge: A package for automatic evaluation of summaries
Chin-Yew Lin. 2004 · 2004
Earlier work this paper cites.
Textrank: Bringing order into text
Rada Mihalcea and Paul Tarau. 2004 · 2004
Earlier work this paper cites.
Meteor: An automatic metric for mt evaluation with improved correlation with human judgments
Satanjeev Banerjee and Alon Lavie. 2005 · 2005
Earlier work this paper cites.
Duc 2005: Evaluation of question-focused summarization systems
Hoa Trang Dang. 2006 · 2005
Earlier work this paper cites.
Learning-based single-document summarization with compression and anaphoricity constraints
Greg Durrett, Taylor Berg-Kirkpatrick, and Dan Klein. 2016 · 2008
Earlier work this paper cites.

Similar

The new york times annotated corpus
Evan Sandhaus. 2008 · 2008
Cited alongside, same era.
Using mechanical turk to create a corpus of arabic summaries
M El-Haj, U Kruschwitz, and C Fox. 2010 · 2010
Cited alongside, same era.
A new approach to improving multilingual summarization using a genetic algorithm
Marina Litvak, Mark Last, and Menahem Friedman. 2010 · 2010
Cited alongside, same era.
Statistical parsing of morphologically rich languages (spmrl): what, how and whither
Reut Tsarfaty, Djamé Seddah, Yoav Goldberg, Sandra Kübler, Marie Candito, Jennifer Foster, Yannick Versley, Ines Rehbein, and Lamia Tounsi. 2010 · 2010
Cited alongside, same era.
Annotated gigaword
Courtney Napoles, Matthew Gormley, and Benjamin Van Durme. 2012 · 2012
Cited alongside, same era.
Kalimat a multipurpose arabic corpus
Mahmoud El-Haj and Rim Koulali. 2013 · 2013
Cited alongside, same era.
A decade of automatic content evaluation of news summaries: Reassessing the state of the art
Peter A. Rankel, John M. Conroy, Hoa Trang Dang, and Ani Nenkova. 2013 · 2013
Cited alongside, same era.
Neural machine translation by jointly learning to align and translate
Original
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014 · 2014
Cited alongside, same era.
Improving the estimation of word importance for news multi-document summarization
Kai Hong and Ani Nenkova. 2014 · 2014
Cited alongside, same era.
Sequence to sequence learning with neural networks
I Sutskever, O Vinyals, and QV Le. 2014 · 2014
Cited alongside, same era.
A large annotated corpus for learning natural language inference
Original
Samuel R Bowman, Gabor Angeli, Christopher Potts, and Christopher D Manning. 2015 · 2015
Cited alongside, same era.
Multiling 2015: multilingual summarization of single and multi-documents, on-line fora, and call-center conversations
George Giannakopoulos, Jeff Kubina, John Conroy, Josef Steinberger, Benoit Favre, Mijail Kabadjov, Udo Kruschwitz, and Massimo Poesio. 2015 · 2015
Cited alongside, same era.

Then

Get to the point: Summarization with pointer-generator networks
Abigail See, Peter J Liu, and Christopher D Manning. 2017 · 2017
Later among the works it cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Later among the works it cites.
Quac: Question answering in context
Original
Eunsol Choi, He He, Mohit Iyyer, Mark Yatskar, Wen-tau Yih, Yejin Choi, Percy Liang, and Luke Zettlemoyer. 2018 · 2018
Later among the works it cites.
Xnli: Evaluating cross-lingual sentence representations
Alexis Conneau, Ruty Rinott, Guillaume Lample, Adina Williams, Samuel R. Bowman, Holger Schwenk, and Veselin Stoyanov. 2018 · 2018
Later among the works it cites.
Newsroom: A dataset of 1.3 million summaries with diverse extractive strategies
Max Grusky, Mor Naaman, and Yoav Artzi. 2018 · 2018
Later among the works it cites.
Improving abstraction in text summarization
Wojciech Kryściński, Romain Paulus, Caiming Xiong, and Richard Socher. 2018 · 2018
Later among the works it cites.
Don’t give me the details, just the summary! Topic-aware convolutional neural networks for extreme summarization
Shashi Narayan, Shay B. Cohen, and Mirella Lapata. 2018a · 2018
Later among the works it cites.
Ranking sentences for extractive summarization with reinforcement learning
Shashi Narayan, Shay B. Cohen, and Mirella Lapata. 2018b · 2018
Later among the works it cites.
Deep contextualized word representations
Matthew E Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018 · 2018
Later among the works it cites.
A new annotated portuguese/spanish corpus for the multi-sentence compression task
Elvys Linhares Pontes, Juan-Manuel Torres-Moreno, Stéphane Huet, and Andréa Carneiro Linhares. 2018 · 2018
Later among the works it cites.
Improving language understanding by generative pre-training
Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018 · 2018
Later among the works it cites.
Better rewards yield better summaries: Learning to summarise without references
Florian Böhm, Yang Gao, Christian M. Meyer, Ori Shapira, Ido Dagan, and Iryna Gurevych. 2019 · 2019
Later among the works it cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Later among the works it cites.
Zero-shot cross-lingual abstractive sentence summarization through teaching generation and attention
Xiangyu Duan, Mingming Yin, Min Zhang, Boxing Chen, and Weihua Luo. 2019 · 2019
Later among the works it cites.
Question answering as an automatic evaluation metric for news article summarization
Matan Eyal, Tal Baumel, and Michael Elhadad. 2019 · 2019
Later among the works it cites.
The flores evaluation datasets for low-resource machine translation: Nepali–english and sinhala–english
Francisco Guzmán, Peng-Jen Chen, Myle Ott, Juan Pino, Guillaume Lample, Philipp Koehn, Vishrav Chaudhary, and Marc’Aurelio Ranzato. 2019 · 2019
Later among the works it cites.
Text summarization with pretrained encoders
Yang Liu and Mirella Lapata. 2019 · 2019
Later among the works it cites.
Answers unite! unsupervised metrics for reinforced summarization models
Thomas Scialom, Sylvain Lamprier, Benjamin Piwowarski, and Jacopo Staiano. 2019 · 2019
Later among the works it cites.
A robust abstractive system for cross-lingual summarization
Jessica Ouyang, Boya Song, and Kathleen McKeown. 2019 · 2031
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…