Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages

Understand

Language models based on the Transformer architecture have achieved state-of-the-art performance on a wide range of NLP tasks such as text classification, question-answering, and token classification.

• However, this performance is usually tested and reported on high-resource languages, like English, French, Spanish, and German.
• Indian languages, on the other hand, are underrepresented in such benchmarks.
• Despite some Indian languages being included in training multilingual Transformer models, they have not been the primary focus of such work.