Federated Learning for Emoji Prediction in a Mobile Keyboard

Towards federated learning at scale: System design

Original

Keith Bonawitz, Hubert Eichner, Wolfgang Grieskamp, Dzmitry Huba, Alex Ingerman, Vladimir Ivanov, Chloe Kiddon, Jakub Konecny, Stefano Mazzocchi, H Brendan McMahan, et al. 2019 · 1902

Earlier work this paper cites.

Long short-term memory

Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997

Earlier work this paper cites.

On the importance of initialization and momentum in deep learning

Ilya Sutskever, James Martens, George Dahl, and Geoffrey Hinton. 2013 · 2013

Earlier work this paper cites.

Learning phrase representations using RNN encoder–decoder for statistical machine translation

Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014 · 2014

Earlier work this paper cites.

Deep learning with differential privacy

Martin Abadi, Andy Chu, Ian Goodfellow, H Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang. 2016 · 2016

Earlier work this paper cites.

Practical secure aggregation for privacy-preserving machine learning

Keith Bonawitz, Vladimir Ivanov, Ben Kreuter, Antonio Marcedone, H. Brendan McMahan, Sarvar Patel, Daniel Ramage, Aaron Segal, and Karn Seth. 2017 · 2017

Earlier work this paper cites.

Natural language processing with small feed-forward networks

Jan A. Botha, Emily Pitler, Ji Ma, Anton Bakalov, Alex Salcianu, David I Weiss, Ryan T. McDonald, and Slav Petrov. 2017 · 2017

Earlier work this paper cites.

Google Vizier: A Service for Black-Box Optimization

Daniel Golovin, Benjamin Solnik, Subhodeep Moitra, Greg Kochanski, John Elliot Karro, and D. Sculley, editors. 2017 · 2017

Cited alongside, same era.

Lstm: A search space odyssey

Klaus Greff, Rupesh Kumar Srivastava, Jan Koutnx00EDk, Bas R. Steunebrink, and Jx00FCrgen Schmidhuber. 2017 · 2017

Cited alongside, same era.

Transliterated mobile keyboard input via weighted finite-state transducers

Lars Hellsten, Brian Roark, Prasoon Goyal, Cyril Allauzen, Francoise Beaufays, Tom Ouyang, Michael Riley, and David Rybach. 2017 · 2017

Cited alongside, same era.

Communication-efficient learning of deep networks from decentralized data

Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Agüera y Arcas. 2017 · 2017

Cited alongside, same era.

Using the output embedding to improve language models

Ofir Press and Lior Wolf. 2017 · 2017

Cited alongside, same era.

Learning to generate reviews and discovering sentiment

Federated learning for mobile keyboard prediction

Original

Andrew Hard, Kanishka Rao, Rajiv Mathews, Françoise Beaufays, Sean Augenstein, Hubert Eichner, Chloé Kiddon, and Daniel Ramage. 2018 · 2018

Later among the works it cites.

Universal language model fine-tuning for text classification

Jeremy Howard and Sebastian Ruder. 2018 · 2018

Later among the works it cites.

Learning differentially private recurrent language models

Brendan McMahan, Daniel Ramage, Kunal Talwar, and Li Zhang. 2018 · 2018

Later among the works it cites.

Don’t decay the learning rate, increase the batch size

Samuel L. Smith, Pieter-Jan Kindermans, and Quoc V. Le. 2018 · 2018

Later among the works it cites.

Applied federated learning: Improving google keyboard query suggestion

Original

Timothy Yang, Galen Andrew, Hubert Eichner, Haicheng Sun, Wei Li, Nicholas Kong, Daniel Ramage, and Françoise Beaufays. 2018 · 2018

Later among the works it cites.