Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi

S. Rönnqvist, J. Kanerva, T. Salakoski, and F. Ginter, “Is multilingual BERT fluent in language generation?” CoRR , vol. abs/1910.03806, 2019. [Online]. Available: http://arxiv.org/abs/1910.03806

Original

1910

Earlier work this paper cites.

A. Conneau, K. Khandelwal, N. Goyal, V. Chaudhary, G. Wenzek, F. Guzmán, E. Grave, M. Ott, L. Zettlemoyer, and V. Stoyanov, “Unsupervised cross-lingual representation learning at scale,” CoRR , vol. abs/1911.02116, 2019. [Online]. Available: http://arxiv.org/abs/1911.02116

Original

1911

Earlier work this paper cites.

D. Q. Nguyen and A. T. Nguyen, “Phobert: Pre-trained language models for vietnamese,” CoRR , vol. abs/2003.00744, 2020. [Online]. Available: https://arxiv.org/abs/2003.00744

Original

2003

Earlier work this paper cites.

K. Jain, A. Deshpande, K. Shridhar, F. Laumann, and A. Dash, “Indic-transformers: An analysis of transformer language models for indian languages,” CoRR , vol. abs/2011.02323, 2020. [Online]. Available: https://arxiv.org/abs/2011.02323

Original

2011

Earlier work this paper cites.

R. Scheible, F. Thomczyk, P. Tippmann, V. Jaravine, and M. Boeker, “Gottbert: a pure german language model,” CoRR , vol. abs/2012.02110, 2020. [Online]. Available: https://arxiv.org/abs/2012.02110

Original

2012

Earlier work this paper cites.

M. S. Islam, F. E. M. Jubayer, and S. I. Ahmed, “A comparative study on different types of approaches to bengali document categorization,” CoRR , vol. abs/1701.08694, 2017. [Online]. Available: http://arxiv.org/abs/1701.08694

Original

2017

Earlier work this paper cites.

J. Devlin, M. Chang, K. Lee, and K. Toutanova, “BERT: pre-training of deep bidirectional transformers for language understanding,” CoRR , vol. abs/1810.04805, 2018. [Online]. Available: http://arxiv.org/abs/1810.04805

Original

2018

Earlier work this paper cites.

T. Pires, E. Schlinger, and D. Garrette, “How multilingual is multilingual bert?” in Proceedings of the 57th Conference of the Association for Computational Linguistics, ACL 2019, Florence, Italy, July 28- August 2, 2019, Volume 1: Long Papers , A. Korhonen, D. R. Traum, and L. Màrquez, Eds. Association for Computational Linguistics, 2019, pp. 4996–5001. [Online]. Available: https://doi.org/10.18653/v1/p19-1493

2019

Earlier work this paper cites.

——, “How multilingual is multilingual BERT?” in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics . Florence, Italy: Association for Computational Linguistics, Jul. 2019, pp. 4996–5001. [Online]. Available: https://aclanthology.org/P19-1493

2019

Earlier work this paper cites.

R. Joshi, P. Goel, and R. Joshi, “Deep learning for hindi text classification: A comparison,” in Intelligent Human Computer Interaction - 11th International Conference, IHCI 2019, Allahabad, India, December 12-14, 2019, Proceedings , ser. Lecture Notes in Computer Science, U. S. Tiwary and S. Chaudhury, Eds., vol. 11886. Springer, 2019, pp. 94–101. [Online]. Available: https://doi.org/10.1007/978-3-030-44689-5_9

2019

Earlier work this paper cites.

G. Jawahar, B. Sagot, and D. Seddah, “What does BERT learn about the structure of language?” in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics . Florence, Italy: Association for Computational Linguistics, Jul. 2019, pp. 3651–3657. [Online]. Available: https://aclanthology.org/P19-1356

2019

Cited alongside, same era.

I. Tenney, D. Das, and E. Pavlick, “BERT rediscovers the classical NLP pipeline,” in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics . Florence, Italy: Association for Computational Linguistics, Jul. 2019, pp. 4593–4601. [Online]. Available: https://aclanthology.org/P19-1452

2019

Cited alongside, same era.

H. Le, L. Vial, J. Frej, V. Segonne, M. Coavoux, B. Lecouteux, A. Allauzen, B. Crabbé, L. Besacier, and D. Schwab, “FlauBERT: Unsupervised language model pre-training for French,” in Proceedings of the 12th Language Resources and Evaluation Conference . Marseille, France: European Language Resources Association, May 2020, pp. 2479–2490. [Online]. Available: https://aclanthology.org/2020.lrec-1.302

2020

Cited alongside, same era.

A. Velankar, H. Patil, A. Gore, S. Salunke, and R. Joshi, “Hate and offensive speech detection in hindi and marathi,” CoRR , vol. abs/2110.12200, 2021. [Online]. Available: https://arxiv.org/abs/2110.12200

Original

2021

Later among the works it cites.

A. Kulkarni, M. Mandhane, M. Likhitkar, G. Kshirsagar, and R. Joshi, “L3cubemahasent: A marathi tweet-based sentiment analysis dataset,” in Proceedings of the Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, WASSA@EACL 2021, Online, April 19, 2021 , O. D. Clercq, A. Balahur, J. Sedoc, V. Barrière, S. Tafreshi, S. Buechel, and V. Hoste, Eds. Association for Computational Linguistics, 2021, pp. 213–220. [Online]. Available: https://aclanthology.org/2021.wassa-1.23/

2021

Later among the works it cites.

M. Straka, J. Náplava, J. Straková, and D. Samuel, “Robeczech: Czech roberta, a monolingual contextualized language representation model,” CoRR , vol. abs/2105.11314, 2021. [Online]. Available: https://arxiv.org/abs/2105.11314

Original

2021

Later among the works it cites.