IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languages

Understand

Natural Language Generation (NLG) for non-English languages is hampered by the scarcity of datasets in these languages.

• In this paper, we present the IndicNLG Benchmark, a collection of datasets for benchmarking NLG for 11 Indic languages.
• We focus on five diverse tasks, namely, biography generation using Wikipedia infoboxes, news headline generation, sentence summarization, paraphrase generation and, question generation.
• We describe the created datasets and use them to benchmark the performance of several monolingual and multilingual baselines that leverage pre-trained sequence-to-sequence models.