Fast and Memory Efficient Differentially Private-SGD via JL Projections

Differentially private learning with adaptive clipping

Original

Om Thakkar, Galen Andrew, and H. Brendan McMahan · 1905

Earlier work this paper cites.

Neural network studies, 1. comparison of overfitting and overtraining

Igor V. Tetko, David J. Livingstone, and Alexander I. Luik · 1995

Earlier work this paper cites.

Calibrating noise to sensitivity in private data analysis

Cynthia Dwork, Frank McSherry, Kobbi Nissim, and Adam Smith · 2006

Earlier work this paper cites.

Understanding gradient clipping in private SGD: A geometric perspective

Original

Xiangyi Chen, Zhiwei Steven Wu, and Mingyi Hong · 2006

Earlier work this paper cites.

Bypassing the ambient dimension: Private SGD with gradient subspace identification

Original

Yingxue Zhou, Zhiwei Steven Wu, and Arindam Banerjee · 2007

Earlier work this paper cites.

Privacy amplification via random check-ins

Original

Borja Balle, Peter Kairouz, H. Brendan McMahan, Om Thakkar, and Abhradeep Thakurta · 2007

Earlier work this paper cites.

Efficient per-example gradient computations

Original

Ian Goodfellow · 2015

Earlier work this paper cites.

Deep learning with differential privacy

Martin Abadi, Andy Chu, Ian Goodfellow, H Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang · 2016

Earlier work this paper cites.

Membership inference attacks against machine learning models

Reza Shokri, Marco Stronati, Congzheng Song, and Vitaly Shmatikov · 2017

Cited alongside, same era.

Rényi differential privacy

Ilya Mironov · 2017

Cited alongside, same era.

Automatic differentiation in machine learning: a survey

Atılım Günes Baydin, Barak A Pearlmutter, Alexey Andreyevich Radul, and Jeffrey Mark Siskind · 2017

Cited alongside, same era.

A new trick for calculating Jacobian vector products

Jamie Townsend · 2017

Cited alongside, same era.

Learning differentially private recurrent language models

H. Brendan McMahan, Daniel Ramage, Kunal Talwar, and Li Zhang · 2018

Cited alongside, same era.

Gaussian differential privacy, 2019

Jinshuo Dong, Aaron Roth, and Weijie J. Su · 2019

Cited alongside, same era.

The secret sharer: Evaluating and testing unintended memorization in neural networks

Nicholas Carlini, Chang Liu, Úlfar Erlingsson, Jernej Kos, and Dawn Song · 2019

Later among the works it cites.

Deep learning with gaussian differential privacy, 2019

Zhiqi Bu, Jinshuo Dong, Qi Long, and Weijie J. Su · 2019

Later among the works it cites.

Efficient per-example gradient computations in convolutional neural networks

Original

Gaspar Rochette, Andre Manoel, and Eric W Tramel · 2019

Later among the works it cites.

Does learning require memorization? a short tale about a long tail

Vitaly Feldman · 2020

Later among the works it cites.

Generative models for effective ML on private, decentralized datasets

Sean Augenstein, H. Brendan McMahan, Daniel Ramage, Swaroop Ramaswamy, Peter Kairouz, Mingqing Chen, Rajiv Mathews, and Blaise Agüera y Arcas · 2020

Later among the works it cites.