2020

WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization

Ladhak, Faisal, Durmus, Esin, Cardie, Claire et al.

Understand

We introduce WikiLingua, a large-scale, multilingual dataset for the evaluation of crosslingual abstractive summarization systems.

We extract article and summary pairs in 18 languages from WikiHow, a high quality, collaborative resource of how-to guides on a diverse set of topics written by human authors.
We create gold-standard article-summary alignments across languages by aligning the images that are used to describe each how-to step in an article.
As a set of baselines for further studies, we evaluate the performance of existing cross-lingual abstractive summarization methods on our dataset.

Built on

Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension
Original
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, and Luke Zettlemoyer. 2019a · 1910
Earlier work this paper cites.
LCSTS: A large scale Chinese short text summarization dataset
Baotian Hu, Qingcai Chen, and Fangze Zhu. 2015 · 1972
Earlier work this paper cites.
Automatic condensation of electronic publications by sentence selection
Ronald Brandow, Karl Mitze, and Lisa F. Rau. 1995 · 1995
Earlier work this paper cites.
Cross-lingual c*st*rd: English access to hindi information
Anton Leuski, Chin-Yew Lin, Liang Zhou, Ulrich Germann, Franz Josef Och, and Eduard Hovy. 2003 · 2003
Earlier work this paper cites.
Multi-document summarization using cross-language texts
Jung-Min Lim, In-Su Kang, and Jong-Hyeok Lee. 2004 · 2004
Earlier work this paper cites.
ROUGE: A package for automatic evaluation of summaries
Chin-Yew Lin. 2004 · 2004
Earlier work this paper cites.
Evaluation of a cross-lingual Romanian-English multi-document summariser
Constantin Orăsan and Oana Andreea Chiorean. 2008 · 2008
Earlier work this paper cites.
Cross-language document summarization based on machine translation quality prediction
Xiaojun Wan, Huiying Li, and Jianguo Xiao. 2010 · 2010
Earlier work this paper cites.
Bilingual co-training for sentiment classification of Chinese product reviews
Xiaojun Wan. 2011 · 2011
Earlier work this paper cites.
Multi-document multilingual summarization corpus preparation, part 2: Czech, Hebrew and Spanish
Michael Elhadad, Sabino Miranda-Jiménez, Josef Steinberger, and George Giannakopoulos. 2013 · 2013
Earlier work this paper cites.
Multi-document multilingual summarization and evaluation tracks in ACL 2013 MultiLing workshop
George Giannakopoulos. 2013 · 2013
Earlier work this paper cites.
ACL 2013 MultiLing pilot overview
Jeff Kubina, John Conroy, and Judith Schlesinger. 2013 · 2013
Earlier work this paper cites.
Multi-document multilingual summarization corpus preparation, part 1: Arabic, English, Greek, Chinese, Romanian
Lei Li, Corina Forascu, Mahmoud El-Haj, and George Giannakopoulos. 2013 · 2013
Earlier work this paper cites.
MultiLing 2015: Multilingual summarization of single and multi-documents, on-line fora, and call-center conversations
George Giannakopoulos, Jeff Kubina, John Conroy, Josef Steinberger, Benoit Favre, Mijail Kabadjov, Udo Kruschwitz, and Massimo Poesio. 2015 · 2015
Earlier work this paper cites.
Teaching machines to read and comprehend
Karl Moritz Hermann, Tomáš Kočiský, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, and Phil Blunsom. 2015 · 2015
Earlier work this paper cites.

Similar

A neural attention model for abstractive sentence summarization
Alexander M. Rush, Sumit Chopra, and Jason Weston. 2015 · 2015
Cited alongside, same era.
Pointer networks
Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. 2015 · 2015
Cited alongside, same era.
Phrase-based compressive cross-language summarization
Jin-ge Yao, Xiaojun Wan, and Jianguo Xiao. 2015 · 2015
Cited alongside, same era.
Abstractive sentence summarization with attentive recurrent neural networks
Sumit Chopra, Michael Auli, and Alexander M. Rush. 2016 · 2016
Cited alongside, same era.
Abstractive text summarization using sequence-to-sequence RNNs and beyond
Ramesh Nallapati, Bowen Zhou, Cicero dos Santos, Çağlar Gu̇lçehre, and Bing Xiang. 2016 · 2016
Cited alongside, same era.
Improving neural machine translation models with monolingual data
Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016 · 2016
Cited alongside, same era.
Abstractive cross-language summarization via translation model enhanced predicate argument structure fusing
J. Zhang, Y. Zhou, and C. Zong. 2016 · 2016
Cited alongside, same era.
Get to the point: Summarization with pointer-generator networks
Abigail See, Peter J. Liu, and Christopher D. Manning. 2017 · 2017
Cited alongside, same era.
Data statements for natural language processing: Toward mitigating system bias and enabling better science
Emily M. Bender and Batya Friedman. 2018 · 2018
Cited alongside, same era.
Fast abstractive summarization with reinforce-selected sentence rewriting
Yen-Chun Chen and Mohit Bansal. 2018 · 2018
Cited alongside, same era.
Understanding back-translation at scale
Sergey Edunov, Myle Ott, Michael Auli, and David Grangier. 2018 · 2018
Cited alongside, same era.
Bottom-up abstractive summarization
Original
Sebastian Gehrmann, Yuntian Deng, and Alexander M Rush. 2018 · 2018
Cited alongside, same era.

Then

Don’t give me the details, just the summary! Topic-aware convolutional neural networks for extreme summarization
Shashi Narayan, Shay B. Cohen, and Mirella Lapata. 2018 · 2018
Later among the works it cites.
Zero-shot cross-lingual neural headline generation
Shi-qi Shen, Yun Chen, Cheng Yang, Zhi-yuan Liu, and Mao-song Sun. 2018 · 2018
Later among the works it cites.
MSMO: Multimodal summarization with multimodal output
Junnan Zhu, Haoran Li, Tianshang Liu, Yu Zhou, Jiajun Zhang, and Chengqing Zong. 2018 · 2018
Later among the works it cites.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Later among the works it cites.
Zero-shot cross-lingual abstractive sentence summarization through teaching generation and attention
Xiangyu Duan, Mingming Yin, Min Zhang, Boxing Chen, and Weihua Luo. 2019 · 2019
Later among the works it cites.
Text summarization with pretrained encoders
Yang Liu and Mirella Lapata. 2019 · 2019
Later among the works it cites.
Global voices: Crossing borders in automatic news summarization
Khanh Nguyen and Hal Daumé III. 2019 · 2019
Later among the works it cites.
fairseq: A fast, extensible toolkit for sequence modeling
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, and Michael Auli. 2019 · 2019
Later among the works it cites.
Cross-lingual transfer learning for multilingual task oriented dialog
Sebastian Schuster, Sonal Gupta, Rushin Shah, and Mike Lewis. 2019 · 2019
Later among the works it cites.
Cross-language document summarization via extraction and ranking of multiple summaries
Xiaojun Wan, Fuli Luo, Xue Sun, Songfang Huang, and Jin-ge Yao. 2019 · 2019
Later among the works it cites.
NCLS: Neural cross-lingual summarization
Junnan Zhu, Qian Wang, Yining Wang, Yu Zhou, Jiajun Zhang, Shaonan Wang, and Chengqing Zong. 2019 · 2019
Later among the works it cites.
Multilingual denoising pre-training for neural machine translation
Original
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, and Luke Zettlemoyer. 2020 · 2020
Closest in time.
Controlling the amount of verbatim copying in abstractive summarization
Kaiqiang Song, Bingqing Wang, Zhe Feng, Liu Ren, and Fei Liu. 2020 · 2020
Closest in time.
A robust abstractive system for cross-lingual summarization
Jessica Ouyang, Boya Song, and Kathy McKeown. 2019 · 2031
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…