The Influence of Dropout on Membership Inference in Differentially Private Models

Dropout: a simple way to prevent neural networks from overfitting

Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014 · 1958

Earlier work this paper cites.

The MNIST database of handwritten digits

Yann LeCun. 1998 · 1998

Earlier work this paper cites.

Learning multiple layers of features from tiny images

Alex Krizhevsky, Geoffrey Hinton, et al · 2009

Earlier work this paper cites.

Spike and Slab Variational Inference for Multi-Task and Multiple Kernel Learning. In Advances in Neural Information Processing Systems , J. Shawe-Taylor, R. Zemel, P. Bartlett, F. Pereira, and K. Q. Weinberger (Eds.), Vol. 24. Curran Associates, Inc

Michalis Titsias and Miguel Lázaro-Gredilla. 2011 · 2011

Earlier work this paper cites.

LeNet-5, convolutional neural networks

Yann LeCun et al · 2015

Earlier work this paper cites.

VERY DEEP CONVOLUTIONAL NETWORKS FOR LARGE-SCALE IMAGE RECOGNITION

Karen Simonyan and Andrew Zisserman. 2015 · 2015

Cited alongside, same era.

Deep learning with differential privacy. In Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security . 308–318

Martin Abadi, Andy Chu, Ian Goodfellow, H Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang. 2016 · 2016

Cited alongside, same era.

Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In international conference on machine learning . 1050–1059

Yarin Gal and Zoubin Ghahramani. 2016 · 2016

Cited alongside, same era.

Membership inference attacks against machine learning models. In 2017 IEEE Symposium on Security and Privacy (SP) . IEEE, 3–18

Reza Shokri, Marco Stronati, Congzheng Song, and Vitaly Shmatikov. 2017 · 2017

Cited alongside, same era.

Membership Inference Attack against Differentially Private Deep Learning Model

Md Atiqur Rahman, Tanzila Rahman, Robert Laganière, Noman Mohammed, and Yang Wang. 2018 · 2018

Differential privacy has disparate impact on model accuracy. In Advances in Neural Information Processing Systems . 15479–15488

Eugene Bagdasaryan, Omid Poursaeed, and Vitaly Shmatikov. 2019 · 2019

Later among the works it cites.

The secret sharer: Evaluating and testing unintended memorization in neural networks. In 28th { \{ USENIX } \} Security Symposium ( { \{ USENIX } \} Security 19) . 267–284

Nicholas Carlini, Chang Liu, Úlfar Erlingsson, Jernej Kos, and Dawn Song. 2019 · 2019

Later among the works it cites.

ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Models. In Network and Distributed Systems Security Symposium 2019 . Internet Society

Ahmed Salem, Yang Zhang, Mathias Humbert, Mario Fritz, and Michael Backes. 2019 · 2019

Later among the works it cites.

Extracting Training Data from Large Language Models

Original

Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, et al · 2020

Later among the works it cites.