XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond

Understand

Language models are ubiquitous in current NLP, and their multilingual capacity has recently attracted considerable attention.

• However, current analyses have almost exclusively focused on (multilingual variants of) standard benchmarks, and have relied on clean pre-training and task-specific corpora as multilingual signals.
• In this paper, we introduce XLM-T, a model to train and evaluate multilingual language models in Twitter.
• In this paper we provide: (1) a new strong multilingual baseline consisting of an XLM-R (Conneau et al.