Fetching the paper…
Reading the bibliography…
In natural language processing (NLP), there is a need for more resources in Portuguese, since much of the data used in the state-of-the-art research is in other languages.
HAREM: An advanced NER evaluation contest for Portuguese
Diana Santos, Nuno Seco, Nuno Cardoso, and Rui Vilela · 2006
Earlier work this paper cites.
Decoupled weight decay regularization, 2017
Ilya Loshchilov and Frank Hutter · 2017
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Earlier work this paper cites.
Subword regularization: Improving neural network translation models with multiple subword candidates
Taku Kudo · 2018
Earlier work this paper cites.
Taku Kudo and John Richardson · 2018
Earlier work this paper cites.
Adafactor: Adaptive learning rates with sublinear memory cost
Noam Shazeer and Mitchell Stern · 2018
Earlier work this paper cites.
The brwac corpus: A new open resource for brazilian portuguese
Jorge A Wagner Filho, Rodrigo Wilkens, Marco Idiart, and Aline Villavicencio · 2018
Earlier work this paper cites.
Adaptation of deep bidirectional multilingual transformers for russian language
Yuri Kuratov and Mikhail Arkhipov · 2019
Earlier work this paper cites.
On the variance of the adaptive learning rate and beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, and Jiawei Han · 2019
Cited alongside, same era.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov · 2019
Cited alongside, same era.
Camembert: a tasty french language model
Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, Yoann Dupont, Laurent Romary, Éric Villemonte de la Clergerie, Djamé Seddah, and Benoît Sagot · 2019
Cited alongside, same era.
AlBERTo: Italian BERT Language Understanding Model for NLP Challenging Tasks Based on Tweets
Marco Polignano, Pierpaolo Basile, Marco de Gemmis, Giovanni Semeraro, and Valerio Basile · 2019
Cited alongside, same era.
Wietse de Vries, Andreas van Cranenburgh, Arianna Bisazza, Tommaso Caselli, Gertjan van Noord, and Malvina Nissim · 2019
Later among the works it cites.
Arabert: Transformer-based model for arabic language understanding
Fady Baly, Hazem Hajj, et al · 2020
Closest in time.
Spanish pre-trained bert model and evaluation data
José Cañete, Gabriel Chaperon, Rodrigo Fuentes, and Jorge Pérez · 2020
Closest in time.
RobBERT: a Dutch RoBERTa-based Language Model
Pieter Delobelle, Thomas Winters, and Bettina Berendt · 2020
Closest in time.
Phobert: Pre-trained language models for vietnamese
Dat Quoc Nguyen and Anh Tuan Nguyen · 2020
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu · 2019
Cited alongside, same era.
Portuguese named entity recognition using bert-crf
Fábio Souza, Rodrigo Nogueira, and Roberto Lotufo · 2019
Cited alongside, same era.
Multilingual is not enough: Bert for finnish
Antti Virtanen, Jenna Kanerva, Rami Ilo, Jouni Luoma, Juhani Luotolahti, Tapio Salakoski, Filip Ginter, and Sampo Pyysalo · 2019
Cited alongside, same era.
Wide and deep transformers applied to semantic relatedness and textual entailment
Evandro Fonseca and João Paulo Reis Alvarenga
Cited in the paper.
Multilingual transformer ensembles for portuguese natural language tasks
Ruan Rodrigues, Jéssica da Silva, Pedro Castro, Nadia Felix, and Anderson Soares
Cited in the paper.
Ipr: The semantic textual similarity and recognizing textual entailment systems
Rui Rodrigues, Paula Couto, and Irene Rodrigues
Cited in the paper.
Proceedings of the ASSIN 2 Shared Task: Evaluating Semantic Textual Similarity and Textual Entailment in Portuguese, Extended Semantic Web Conference
Hugo Gonçalo Oliveira, Livy Real, and Erick Fonseca, editors · 2020
Closest in time.
The assin 2 shared task: a quick overview
Livy Real, Erick Fonseca, and Hugo Gonçalo Oliveira · 2020
Closest in time.