Toxicity Detection for Indic Multilingual Social Media Content

Attention is all you need, 2017

Original

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin · 2017

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding, 2019

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019

Earlier work this paper cites.

Mass: Masked sequence to sequence pre-training for language generation, 2019

Kaitao Song, Xu Tan, Tao Qin, Jianfeng Lu, and Tie-Yan Liu · 2019

Earlier work this paper cites.

Experiment tracking with weights and biases, 2020

Lukas Biewald · 2020

Earlier work this paper cites.

Unsupervised cross-lingual representation learning at scale, 2020

Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov · 2020

Cited alongside, same era.

Cross-lingual ability of multilingual bert: An empirical study, 2020

Karthikeyan K, Zihan Wang, Stephen Mayhew, and Dan Roth · 2020

Cited alongside, same era.

IndicNLPSuite: Monolingual corpora, evaluation benchmarks and pre-trained multilingual language models for Indian languages

Divyanshu Kakwani, Anoop Kunchukuttan, Satish Golla, Gokul N.C., Avik Bhattacharyya, Mitesh M. Khapra, and Pratyush Kumar · 2020

Cited alongside, same era.

Rethinking embedding coupling in pre-trained language models

Hyung Won Chung, Thibault Févry, Henry Tsai, Melvin Johnson, and Sebastian Ruder · 2021

Later among the works it cites.

Muril: Multilingual representations for indian languages, 2021

Simran Khanuja, Diksha Bansal, Sarvesh Mehtani, Savya Khosla, Atreyee Dey, Balaji Gopalan, Dilip Kumar Margam, Pooja Aggarwal, Rajiv Teja Nagipogu, Shachi Dave, Shruti Gupta, Subhash Chandra Bose Gali, Vish Subramanian, and Partha Talukdar · 2021

Later among the works it cites.

Masked language modeling and the distributional hypothesis: Order word matters pre-training for little, 2021

Koustuv Sinha, Robin Jia, Dieuwke Hupkes, Joelle Pineau, Adina Williams, and Douwe Kiela · 2021

Later among the works it cites.