Federated Learning Meets Natural Language Processing: A Survey

Understand

Federated Learning aims to learn machine learning models from multiple decentralized edge devices (e.g.

• mobiles) or servers without sacrificing local data privacy.
• Recent Natural Language Processing techniques rely on deep learning and large pre-trained language models.
• However, both big deep neural and language models are trained with huge amounts of data which often lies on the server side.