Spanish Pre-trained BERT Model and Evaluation Data

Understand

The Spanish language is one of the top 5 spoken languages in the world.

• Nevertheless, finding resources to train or evaluate Spanish language models is not an easy task.
• In this paper we help bridge this gap by presenting a BERT-based language model pre-trained exclusively on Spanish data.
• As a second contribution, we also compiled several tasks specifically for the Spanish language in a single repository much in the spirit of the GLUE benchmark.