XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation

Understand

Machine learning has brought striking advances in multilingual natural language processing capabilities over the past year.

• For example, the latest techniques have improved the state-of-the-art performance on the XTREME multilingual benchmark by more than 13 points.
• While a sizeable gap to human-level performance remains, improvements have been easier to achieve in some tasks than in others.
• This paper analyzes the current state of cross-lingual transfer learning and summarizes some lessons learned.