2022

ClueGraphSum: Let Key Clues Guide the Cross-Lingual Abstractive Summarization

Jiang, Shuyu, Tu, Dengbiao, Chen, Xingshu et al.

Understand

Cross-Lingual Summarization (CLS) is the task to generate a summary in one language for an article in a different language.

Previous studies on CLS mainly take pipeline methods or train the end-to-end model using the translated parallel data.
However, the quality of generated cross-lingual summaries needs more further efforts to improve, and the model performance has never been evaluated on the hand-written CLS dataset.
Therefore, we first propose a clue-guided cross-lingual abstractive summarization method to improve the quality of cross-lingual summaries, and then construct a novel hand-written CLS dataset for evaluation.

Built on

J. L. Fleiss, “Measuring nominal scale agreement among many raters.” Psychological bulletin , vol. 76, no. 5, p. 378, 1971
1971
Earlier work this paper cites.
B. Hu, Q. Chen, and F. Zhu, “Lcsts: A large scale chinese short text summarization dataset,” in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing , 2015, pp. 1967–1972
1972
Earlier work this paper cites.
——, “LCSTS: A large scale Chinese short text summarization dataset,” in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing . Lisbon, Portugal: Association for Computational Linguistics, Sep. 2015, pp. 1967–1972. [Online]. Available: https://www.aclweb.org/anthology/D15-1229
1972
Earlier work this paper cites.
Y. Rubner, C. Tomasi, and L. J. Guibas, “The earth mover’s distance as a metric for image retrieval,” International journal of computer vision , vol. 40, no. 2, pp. 99–121, 2000
2000
Earlier work this paper cites.
P. Koehn, F. J. Och, and D. Marcu, “Statistical phrase-based translation,” in Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics , 2003, pp. 127–133
2003
Earlier work this paper cites.
A. Leuski, C.-Y. Lin, L. Zhou, U. Germann, F. J. Och, and E. Hovy, “Cross-lingual c* st* rd: English access to hindi information,” ACM Transactions on Asian Language Information Processing (TALIP) , vol. 2, no. 3, pp. 245–269, 2003
2003
Earlier work this paper cites.
G. Erkan and D. R. Radev, “Lexrank: Graph-based lexical centrality as salience in text summarization,” Journal of artificial intelligence research , vol. 22, pp. 457–479, 2004
2004
Earlier work this paper cites.
J.-M. Lim, I.-S. Kang, and J.-H. Lee, “Multi-document summarization using cross-language texts.” in NTCIR , 2004
2004
Earlier work this paper cites.
C.-Y. Lin, “Rouge: A package for automatic evaluation of summaries,” in Text summarization branches out: Proceedings of the ACL-04 Workshop , 2004, pp. 74–81
2004
Earlier work this paper cites.
R. Mihalcea and P. Tarau, “Textrank: Bringing order into text,” in Proceedings of the 2004 conference on empirical methods in natural language processing , 2004, pp. 404–411
2004
Earlier work this paper cites.
C. Orašan and O. A. Chiorean, “Evaluation of a cross-lingual romanian-english multi-document summariser,” in Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC’08) , 2008
2008
Earlier work this paper cites.
X. Glorot and Y. Bengio, “Understanding the difficulty of training deep feedforward neural networks,” in Proceedings of the thirteenth international conference on artificial intelligence and statistics . JMLR Workshop and Conference Proceedings, 2010, pp. 249–256
2010
Earlier work this paper cites.
X. Wan, H. Li, and J. Xiao, “Cross-language document summarization based on machine translation quality prediction,” in Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics , 2010, pp. 917–926
2010
Earlier work this paper cites.
X. Wan, “Using bilingual information for cross-language document summarization,” in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies , 2011, pp. 1546–1555
2011
Earlier work this paper cites.
M. Denkowski and A. Lavie, “Meteor universal: Language specific translation evaluation for any target language,” in Proceedings of the ninth workshop on statistical machine translation , 2014, pp. 376–380
2014
Earlier work this paper cites.
K. M. Hermann, T. Kocisky, E. Grefenstette, L. Espeholt, W. Kay, M. Suleyman, and P. Blunsom, “Teaching machines to read and comprehend,” Advances in neural information processing systems , vol. 28, pp. 1693–1701, 2015
2015
Earlier work this paper cites.
A. KingaD, “A method for stochastic optimization,” Anon. InternationalConferenceon Learning Representations. SanDego: ICLR , 2015
2015
Earlier work this paper cites.

Similar

J.-g. Yao, X. Wan, and J. Xiao, “Phrase-based compressive cross-language summarization,” in Proceedings of the 2015 conference on empirical methods in natural language processing , 2015, pp. 118–127
2015
Cited alongside, same era.
J. L. Ba, J. R. Kiros, and G. E. Hinton, “Layer normalization,” arXiv preprint arXiv:1607.06450 , 2016
Original
2016
Cited alongside, same era.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 770–778
2016
Cited alongside, same era.
J. Zhang, Y. Zhou, and C. Zong, “Abstractive cross-language summarization via translation model enhanced predicate argument structure fusing,” IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 24, no. 10, pp. 1842–1853, 2016
2016
Cited alongside, same era.
S. Kiritchenko and S. Mohammad, “Best-worst scaling more reliable than rating scales: A case study on sentiment intensity annotation,” in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) , 2017, pp. 465–470
2017
Cited alongside, same era.
A. See, P. J. Liu, and C. D. Manning, “Get to the point: Summarization with pointer-generator networks,” in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2017, pp. 1073–1083
2017
Cited alongside, same era.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” in Proceedings of the 31st International Conference on Neural Information Processing Systems , 2017, pp. 6000–6010
2017
Cited alongside, same era.
J. Xuan, X. Luo, J. Lu, and G. Zhang, “Explicitly and implicitly exploiting the hierarchical structure for mining website interests on news events,” Information Sciences , vol. 420, pp. 263–277, 2017. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0020025517308952
2017
Cited alongside, same era.
S.-q. Ayana, Shen, Y. Chen, C. Yang, Z.-y. Liu, M.-s. Sun et al. , “Zero-shot cross-lingual neural headline generation,” IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 26, no. 12, pp. 2319–2327, 2018
2018
Cited alongside, same era.
P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Liò, and Y. Bengio, “Graph attention networks,” International Conference on Learning Representations , 2018, accepted as poster. [Online]. Available: https://openreview.net/forum?id=rJXMpikCZ
2018
Cited alongside, same era.
J. Zhu, H. Li, T. Liu, Y. Zhou, J. Zhang, and C. Zong, “Msmo: Multimodal summarization with multimodal output,” in Proceedings of the 2018 conference on empirical methods in natural language processing , 2018, pp. 4154–4164
2018
Cited alongside, same era.
K. K. Aldous, J. An, and B. J. Jansen, “View, like, comment, post: Analyzing user engagement by topic at 4 levels across 5 social media platforms for 53 news organizations,” in Proceedings of the International AAAI Conference on Web and Social Media , vol. 13, 2019, pp. 47–57
2019
Cited alongside, same era.

Then

Z. Nasar, S. W. Jaffry, and M. K. Malik, “Textual keyword extraction and summarization: State-of-the-art,” Information Processing & Management , vol. 56, no. 6, p. 102088, 2019. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0306457319300044
2019
Later among the works it cites.
W. Zhao, M. Peyrard, F. Liu, Y. Gao, C. M. Meyer, and S. Eger, “MoverScore: Text generation evaluating with contextualized embeddings and earth mover distance,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) . Hong Kong, China: Association for Computational Linguistics, Nov. 2019, pp. 563–578. [Online]. Available: https://aclanthology.org/D19-1053
2019
Later among the works it cites.
J. Zhu, Q. Wang, Y. Wang, Y. Zhou, J. Zhang, S. Wang, and C. Zong, “NCLS: Neural cross-lingual summarization,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) . Hong Kong, China: Association for Computational Linguistics, Nov. 2019, pp. 3045–3055. [Online]. Available: https://www.aclweb.org/anthology/D19-1302
2019
Later among the works it cites.
Y. Cao, H. Liu, and X. Wan, “Jointly learning to align and summarize for neural cross-lingual summarization,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , 2020, pp. 6220–6231
2020
Later among the works it cites.
Z.-Y. Dou, S. Kumar, and Y. Tsvetkov, “A deep reinforced model for zero-shot cross-lingual summarization with bilingual semantic similarity rewards,” in Proceedings of the Fourth Workshop on Neural Generation and Translation , 2020, pp. 60–68
2020
Later among the works it cites.
Y. Graham, B. Haddow, and P. Koehn, “Translationese in machine translation evaluation,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , 2020, pp. 72–81
2020
Later among the works it cites.
F. Ladhak, E. Durmus, C. Cardie, and K. McKeown, “Wikilingua: A new benchmark dataset for multilingual abstractive summarization,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings , 2020, pp. 4034–4048
2020
Later among the works it cites.
S. Takase and N. Okazaki, “Multi-task learning for cross-lingual abstractive summarization,” arXiv preprint arXiv:2010.07503 , 2020
Original
2020
Later among the works it cites.
R. Xu, C. Zhu, Y. Shi, M. Zeng, and X. Huang, “Mixed-lingual pre-training for cross-lingual summarization,” in Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing . Suzhou, China: Association for Computational Linguistics, Dec. 2020, pp. 536–541. [Online]. Available: https://aclanthology.org/2020.aacl-main.53
2020
Later among the works it cites.
J. Zhu, Y. Zhou, J. Zhang, and C. Zong, “Attend, translate and summarize: An efficient method for neural cross-lingual summarization,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , 2020, pp. 1309–1321
2020
Later among the works it cites.
Y. Bai, Y. Gao, and H. Huang, “Cross-lingual abstractive summarization with limited parallel resources,” arXiv preprint arXiv:2105.13648 , 2021
Original
2021
Later among the works it cites.
Y. Guan, S. Guo, R. Li, X. Li, and H. Zhang, “Frame semantics guided network for abstractive sentence summarization,” Knowledge-Based Systems , vol. 221, p. 106973, 2021. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0950705121002367
2021
Later among the works it cites.
K. K. Maurya, M. S. Desarkar, Y. Kano, and K. Deepshikha, “Zmbart: An unsupervised cross-lingual transfer framework for language generation,” arXiv preprint arXiv:2106.01597 , 2021
Original
2021
Later among the works it cites.
X. Peng, Y. Zheng, C. Lin, and A. Siddharthan, “Summarising historical text in modern languages,” in Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume , 2021, pp. 3123–3142
2021
Later among the works it cites.
L. Xiao, H. He, and Y. Jin, “Fusionsum: Abstractive summarization with sentence fusion and cooperative reinforcement learning,” Knowledge-Based Systems , p. 108483, 2022. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0950705122002052
2022
Closest in time.
J. Ouyang, B. Song, and K. McKeown, “A robust abstractive system for cross-lingual summarization,” in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , 2019, pp. 2025–2031
2031
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…