L3Cube-HindBERT and DevBERT: Pre-Trained BERT Transformer models for Devanagari based Hindi and Marathi Languages

Akhtar, M.S., Kumar, A., Ekbal, A., Bhattacharyya, P.: A hybrid deep learning architecture for sentiment analysis. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. pp. 482–493 (2016)

2016

Earlier work this paper cites.

Pan, X., Zhang, B., May, J., Nothman, J., Knight, K., Ji, H.: Cross-lingual name tagging and linking for 282 languages. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). pp. 1946–1958 (2017)

2017

Earlier work this paper cites.

Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

Original

2018

Earlier work this paper cites.

Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., Stoyanov, V.: Unsupervised cross-lingual representation learning at scale. arXiv preprint arXiv:1911.02116 (2019)

Original

2019

Earlier work this paper cites.

Joshi, R., Goel, P., Joshi, R.: Deep learning for hindi text classification: A comparison. In: International Conference on Intelligent Human Computer Interaction. pp. 94–101. Springer (2019)

2019

Earlier work this paper cites.

Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., Stoyanov, V.: Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019)

Original

2019

Earlier work this paper cites.

Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al.: Huggingface’s transformers: State-of-the-art natural language processing. arXiv preprint arXiv:1910.03771 (2019)

Original

2019

Earlier work this paper cites.

Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, É., Ott, M., Zettlemoyer, L., Stoyanov, V.: Unsupervised cross-lingual representation learning at scale. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. pp. 8440–8451 (2020)

2020

Earlier work this paper cites.

Jain, K., Deshpande, A., Shridhar, K., Laumann, F., Dash, A.: Indic-transformers: An analysis of transformer language models for indian languages. arXiv preprint arXiv:2011.02323 (2020)

Original

2020

Cited alongside, same era.

Kakwani, D., Kunchukuttan, A., Golla, S., Gokul, N., Bhattacharyya, A., Khapra, M.M., Kumar, P.: Indicnlpsuite: Monolingual corpora, evaluation benchmarks and pre-trained multilingual language models for indian languages. In: Findings of the Association for Computational Linguistics: EMNLP 2020. pp. 4948–4961 (2020)

2020

Cited alongside, same era.

Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., Huang, X.: Pre-trained models for natural language processing: A survey. Science China Technological Sciences 63

2020

Cited alongside, same era.

Khanuja, S., Bansal, D., Mehtani, S., Khosla, S., Dey, A., Gopalan, B., Margam, D.K., Aggarwal, P., Nagipogu, R.T., Dave, S., et al.: Muril: Multilingual representations for indian languages. arXiv preprint arXiv:2103.10730 (2021)

Original

2021

Kowsher, M., Sami, A.A., Prottasha, N.J., Arefin, M.S., Dhar, P.K., Koshiba, T.: Bangla-bert: transformer-based efficient model for transfer learning and language understanding. IEEE Access 10

2022

Closest in time.

Kulkarni, A., Mandhane, M., Likhitkar, M., Kshirsagar, G., Jagdale, J., Joshi, R.: Experimental evaluation of deep learning models for marathi text classification. In: Proceedings of the 2nd International Conference on Recent Trends in Machine Learning, IoT, Smart Cities and Applications. pp. 605–613. Springer (2022)

2022

Closest in time.

Litake, O., Sabane, M., Patil, P., Ranade, A., Joshi, R.: Mono vs multilingual bert: A case study in hindi and marathi named entity recognition. arXiv preprint arXiv:2203.12907 (2022)

Original

2022

Closest in time.

Litake, O., Sabane, M.R., Patil, P.S., Ranade, A.A., Joshi, R.: L3cube-mahaner: A marathi named entity recognition dataset and bert models. In: Proceedings of the WILDRE-6 Workshop within the 13th Language Resources and Evaluation Conference. pp. 29–34 (2022)