AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding

Roberta: A robustly optimized bert pretraining approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Unsupervised cross-lingual representation learning at scale

Original

Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1911

Earlier work this paper cites.

Electra: Pre-training text encoders as discriminators rather than generators

Original

Kevin Clark, Minh-Thang Luong, Quoc V Le, and Christopher D Manning. 2020b · 2003

Earlier work this paper cites.

Anersys: An arabic named entity recognition system based on maximum entropy

Yassine Benajiba, Paolo Rosso, and José Miguel BenedíRuiz. 2007 · 2007

Earlier work this paper cites.

Toward micro-dialect identification in diaglossic and code-switched environments

Original

Muhammad Abdul-Mageed, Chiyu Zhang, AbdelRahim Elmadany, and Lyle Ungar. 2020b · 2010

Earlier work this paper cites.

Generative adversarial nets

Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014 · 2014

Earlier work this paper cites.

1.5 billion words arabic corpus

Original

Ibrahim Abu El-Khair. 2016 · 2016

Earlier work this paper cites.

Squad: 100,000+ questions for machine comprehension of text

Original

Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016

Cited alongside, same era.

Aravec: A set of arabic word embedding models for use in arabic nlp

Abu Bakr Soliman, Kareem Eissa, and Samhaa R El-Beltagy. 2017 · 2017

Cited alongside, same era.

Arsentd-lev: A multi-topic corpus for target-based sentiment analysis in arabic levantine tweets

Ramy Baly, Alaa Khaddaj, Hazem Hajj, Wassim El-Hajj, and Khaled Bashir Shaban. 2018 · 2018

Cited alongside, same era.

Bert: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Cited alongside, same era.

hulmona: The universal language model in arabic

Obeida ElJundi, Wissam Antoun, Nour El Droubi, Hazem Hajj, Wassim El-Hajj, and Khaled Shaban. 2019 · 2019

Cited alongside, same era.

Arabert: Transformer-based model for arabic language understanding

Wissam Antoun, Fady Baly, and Hazem Hajj. 2020 · 2020

Closest in time.

Improving Arabic text categorization using transformer training diversification

Shammur Absar Chowdhury, Ahmed Abdelali, Kareem Darwish, Jung Soon-Gyo, Joni Salminen, and Bernard J. Jansen. 2020 · 2020

Closest in time.

Gigabert: Zero-shot transfer learning from english to arabic

Wuwei Lan, Yang Chen, Wei Xu, and Alan Ritter. 2020 · 2020

Closest in time.

CAMeL tools: An open source python toolkit for Arabic natural language processing

Ossama Obeid, Nasser Zalmout, Salam Khalifa, Dima Taji, Mai Oudah, Bashar Alhafni, Go Inoue, Fadhl Eryani, Alexander Erdmann, and Nizar Habash. 2020 · 2020

Closest in time.

A monolingual approach to contextualized word embeddings for mid-resource languages

Pedro Javier Ortiz Suárez, Laurent Romary, and Benoît Sagot. 2020 · 2020

Closest in time.