Architecture Matters: Investigating the Influence of Differential Privacy on Neural Network Design

Gradient-based learning applied to document recognition

Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998

Earlier work this paper cites.

Learning Multiple Layers of Features from Tiny Images

Alex Krizhevsky · 2009

Earlier work this paper cites.

The Algorithmic Foundations of Differential Privacy

Cynthia Dwork and Aaron Roth · 2014

Earlier work this paper cites.

Multi-digit Number Recognition from Street View Imagery using Deep Convolutional Neural Networks

Ian J. Goodfellow, Yaroslav Bulatov, Julian Ibarz, Sacha Arnoud, and Vinay Shet · 2014

Earlier work this paper cites.

TensorFlow: A system for large-scale machine learning

Martin Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng · 2016

Earlier work this paper cites.

Deep Learning with Differential Privacy

Martin Abadi, Andy Chu, Ian Goodfellow, H. Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang · 2016

Earlier work this paper cites.

Deep Residual Learning for Image Recognition

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016

Cited alongside, same era.

Densely Connected Convolutional Networks

Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q. Weinberger · 2017

Cited alongside, same era.

Communication-efficient learning of deep networks from decentralized data

Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas · 2017

Cited alongside, same era.

Adaptive laplace mechanism: Differential privacy preservation in deep learning

NhatHai Phan, Xintao Wu, Han Hu, and Dejing Dou · 2017

Cited alongside, same era.

TensorFlow Privacy

Galen Andrew, Steve Chien, and Nicolas Papernot · 2018

Cited alongside, same era.

Three Tools for Practical Differential Privacy

Original

Koen Lennart van der Veen, Ruben Seggers, Peter Bloem, and Giorgio Patrini · 2018

Local differential privacy for deep learning

Pathum Chamikara Mahawaga Arachchige, Peter Bertok, Ibrahim Khalil, Dongxi Liu, Seyit Camtepe, and Mohammed Atiquzzaman · 2019

Later among the works it cites.

Neural architecture search: A survey

Thomas Elsken, Jan Hendrik Metzen, and Frank Hutter · 2019

Later among the works it cites.

Evaluating Differentially Private Machine Learning in Practice

Bargav Jayaraman and David Evans · 2019

Later among the works it cites.

Making the Shoe Fit: Architectures, Initializations, and Tuning for Learning with Privacy, September 2019

Nicolas Papernot, Steve Chien, Shuang Song, Abhradeep Thakurta, and Ulfar Erlingsson · 2019

Later among the works it cites.

Why Gradient Clipping Accelerates Training: A Theoretical Justification for Adaptivity

Jingzhao Zhang, Tianxing He, Suvrit Sra, and Ali Jadbabaie · 2020

Later among the works it cites.

Tempered Sigmoid Activations for Deep Learning with Differential Privacy