A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translation

Understand

Recent advances in the pre-training of language models leverage large-scale datasets to create multilingual models.

• However, low-resource languages are mostly left out in these datasets.
• This is primarily because many widely spoken languages are not well represented on the web and therefore excluded from the large-scale crawls used to create datasets.
• Furthermore, downstream users of these models are restricted to the selection of languages originally chosen for pre-training.