Fetching the paper…

Reading the bibliography…

2020

Dynamic backdoor attacks against federated learning

Huang, Anbu

Original
PDF
Post on X

Understand

Federated Learning (FL) is a new machine learning framework, which enables millions of participants to collaboratively train machine learning model without compromising data privacy and security.

Due to the independence and confidentiality of each client, FL does not guarantee that all clients are honest by design, which makes it vulnerable to adversarial attack naturally.
In this paper, we focus on dynamic backdoor attacks under FL setting, where the goal of the adversary is to reduce the performance of the model on targeted tasks while maintaining a good performance on the main task, current existing studies are mainly focused on static backdoor attacks, that is the poison pattern injected is unchanged, however, FL is an online learning framework, and adversarial targets can be changed dynamically by attacker, traditional algorithms require learning a new targeted task from scratch, which could be computationally expensive and require a large number of adversarial training examples, to avoid this, we bridge meta-learning and backdoor attacks under FL setting, in which case we can learn a versatile model from previous experiences, and fast adapting to new adversarial tasks with a few of examples.
We evaluate our algorithm on different datasets, and demonstrate that our algorithm can achieve good results with respect to dynamic backdoor attacks.

Dynamic backdoor attacks against federated learning · Around

Built on

Towards Federated Learning at Scale: System Design
Original
Keith Bonawitz, Hubert Eichner, Wolfgang Grieskamp, Dzmitry Huba, Alex Ingerman, Vladimir Ivanov, Chloé Kiddon, Jakub Konecný, Stefano Mazzocchi, H. Brendan McMahan, Timon Van Overveldt, David Petrou, Daniel Ramage, and Jason Roselander. 2019 · 1902
Earlier work this paper cites.
Federated Machine Learning: Concept and Applications
Original
Qiang Yang, Yang Liu, Tianjian Chen, and Yongxin Tong. 2019 · 1902
Earlier work this paper cites.
ImageNet Classification with Deep Convolutional Neural Networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1 (Lake Tahoe, Nevada) (NIPS’12) . Curran Associates Inc., USA, 1097–1105
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012 · 2012
Earlier work this paper cites.
Efficient Estimation of Word Representations in Vector Space
Original
Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013 · 2013
Earlier work this paper cites.
Neural Turing Machines
Original
Alex Graves, Greg Wayne, and Ivo Danihelka. 2014 · 2014
Earlier work this paper cites.
Deep Speech: Scaling up end-to-end speech recognition
Original
Awni Y. Hannun, Carl Case, Jared Casper, Bryan Catanzaro, Greg Diamos, Erich Elsen, Ryan Prenger, Sanjeev Satheesh, Shubho Sengupta, Adam Coates, and Andrew Y. Ng. 2014 · 2014
Earlier work this paper cites.
Memory Networks
Original
Jason Weston, Sumit Chopra, and Antoine Bordes. 2014 · 2014
Earlier work this paper cites.
Deep Residual Learning for Image Recognition
Original
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015 · 2015
Earlier work this paper cites.
Siamese Neural Networks for One-shot Image Recognition
Gregory Koch, Richard Zemel, and Ruslan Salakhutdinov. 2015 · 2015
Earlier work this paper cites.
Deep Learning
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015 · 2015
Earlier work this paper cites.
WaveNet: A Generative Model for Raw Audio
Original
Aäron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew W. Senior, and Koray Kavukcuoglu. 2016 · 2016
Earlier work this paper cites.

Similar

Matching Networks for One Shot Learning
Original
Oriol Vinyals, Charles Blundell, Timothy P. Lillicrap, Koray Kavukcuoglu, and Daan Wierstra. 2016 · 2016
Cited alongside, same era.
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Original
Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017 · 2017
Cited alongside, same era.
Communication-Efficient Learning of Deep Networks from Decentralized Data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research) , Aarti Singh and Jerry Zhu (Eds.), Vol. 54. PMLR, Fort Lauderdale, FL, USA, 1273–1282
Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017 · 2017
Cited alongside, same era.
Prototypical Networks for Few-shot Learning
Original
Jake Snell, Kevin Swersky, and Richard S. Zemel. 2017 · 2017
Cited alongside, same era.

Then

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Original
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018
Later among the works it cites.
On First-Order Meta-Learning Algorithms
Original
Alex Nichol, Joshua Achiam, and John Schulman. 2018 · 2018
Later among the works it cites.
Yolov3: An incremental improvement
Original
Joseph Redmon and Ali Farhadi. 2018 · 2018
Later among the works it cites.
Advances and open problems in federated learning
Original
Peter Kairouz, H Brendan McMahan, Brendan Avent, Aurélien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, Keith Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings, et al · 2019
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Learning to Compare: Relation Network for Few-Shot Learning

Flood Sung, Yongxin Yang, Li Zhang, Tao Xiang, Philip H. S. Torr, and Timothy M. Hospedales. 2017 · 2017

Cited alongside, same era.

Attention is All you Need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Cited alongside, same era.

The EU General Data Protection Regulation (GDPR): A Practical Guide (1st ed.)

Paul Voigt and Axel von dem Bussche. 2017 · 2017

Cited alongside, same era.

How To Backdoor Federated Learning

Eugene Bagdasaryan, Andreas Veit, Yiqing Hua, Deborah Estrin, and Vitaly Shmatikov. 2018 · 2018

Cited alongside, same era.

Analyzing Federated Learning through an Adversarial Lens

Original

Arjun Nitin Bhagoji, Supriyo Chakraborty, Prateek Mittal, and Seraphin B. Calo. 2018 · 2018

Cited alongside, same era.

Federated Meta-Learning for Recommendation

Fei Chen, Zhenhua Dong, Zhenguo Li, and Xiuqiang He. 2018 · 2018

Cited alongside, same era.

Privacy-preserving Federated Brain Tumour Segmentation. In International Workshop on Machine Learning in Medical Imaging . Springer, 133–141

Wenqi Li, Fausto Milletarì, Daguang Xu, Nicola Rieke, Jonny Hancox, Wentao Zhu, Maximilian Baust, Yan Cheng, Sébastien Ourselin, M Jorge Cardoso, et al · 2019

Later among the works it cites.

PyTorch: An Imperative Style, High-Performance Deep Learning Library

Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019 · 2019

Later among the works it cites.

Can You Really Backdoor Federated Learning?

Ziteng Sun, Peter Kairouz, Ananda Theertha Suresh, and H Brendan McMahan. 2019 · 2019

Later among the works it cites.

Fast Context Adaptation via Meta-Learning. In Thirty-sixth International Conference on Machine Learning (ICML)

Luisa Zintgraf, Kyriacos Shiarlis, Vitaly Kurin, Katja Hofmann, and Shimon Whiteson. 2019 · 2019

Later among the works it cites.

FedVision: An Online Visual Object Detection Platform Powered by Federated Learning

Original

Yang Liu, Anbu Huang, Yun Luo, He Huang, Youzhi Liu, Yuanyuan Chen, Lican Feng, Tianjian Chen, Han Yu, and Qiang Yang. 2020 · 2020

Closest in time.

DBA: Distributed Backdoor Attacks against Federated Learning. In International Conference on Learning Representations

Chulin Xie, Keli Huang, Pin-Yu Chen, and Bo Li. 2020 · 2020

Closest in time.