Fetching the paper…
Reading the bibliography…
This paper describes a testing methodology for quantitatively assessing the risk that rare or unique training-data sequences are unintentionally memorized by generative sequence models---a common type of machine-learning model.
The Secret Sharer
Joseph Conrad · 1910
Earlier work this paper cites.
The Kolmogorov-Smirnov test for goodness of fit
Frank J Massey Jr · 1951
Earlier work this paper cites.
Bayes estimation subject to uncertainty about parameter constraints
A O’hagan and Tom Leonard · 1976
Earlier work this paper cites.
A simple weight decay can improve generalization
Anders Krogh and John A Hertz · 1992
Earlier work this paper cites.
Building a large annotated corpus of English: The Penn Treebank
Mitchell P Marcus, Mary Ann Marcinkiewicz, and Beatrice Santorini · 1993
Earlier work this paper cites.
Neural network studies. 1. Comparison of overfitting and overtraining
Igor V. Tetko, David J. Livingstone, and Alexander I. Luik · 1995
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber · 1997
Earlier work this paper cites.
Amazon posts a tell-all of buying lists
Joseph Menn · 1999
Earlier work this paper cites.
A neural probabilistic language model
Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Jauvin · 2003
Earlier work this paper cites.
Revealing information while preserving privacy
Irit Dinur and Kobbi Nissim · 2003
Earlier work this paper cites.
Calibrating noise to sensitivity in private data analysis
C Dwork, F McSherry, K Nissim, and A Smith · 2006
Earlier work this paper cites.
Differential privacy: A survey of results
Cynthia Dwork · 2008
Earlier work this paper cites.
Privacy-preserving logistic regression
Kamalika Chaudhuri and Claire Monteleoni · 2009
Earlier work this paper cites.
Introduction to Algorithms
T Cormen, C Leiserson, R Rivest, and C Stein · 2009
Earlier work this paper cites.
Recurrent neural network based language model
Tomas Mikolov, Martin Karafiát, Lukas Burget, Jan Cernockỳ, and Sanjeev Khudanpur · 2010
Earlier work this paper cites.
Adaptive subgradient methods for online learning and stochastic optimization
John Duchi, Elad Hazan, and Yoram Singer · 2011
Earlier work this paper cites.
Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude
Tijmen Tieleman and Geoffrey Hinton · 2012
Earlier work this paper cites.
ADADELTA: An adaptive learning rate method
Matthew D Zeiler · 2012
Earlier work this paper cites.
Empirical evaluation of gated recurrent neural networks on sequence modeling
Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio · 2014
Earlier work this paper cites.
Privacy in pharmacogenetics: An end-to-end case study of personalized Warfarin dosing
Matthew Fredrikson, Eric Lantz, Somesh Jha, Simon Lin, David Page, and Thomas Ristenpart · 2014
Cited alongside, same era.
Dropout: A simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov · 2014
Cited alongside, same era.
Hacking smart machines with smarter ones: How to extract meaningful data from machine learning classifiers
Giuseppe Ateniese, Luigi V Mancini, Angelo Spognardi, Antonio Villani, Domenico Vitali, and Giovanni Felici · 2015
Cited alongside, same era.
Neural machine translation by jointly learning to align and translate
D Bahdanau, K Cho, and Y Bengio · 2015
Cited alongside, same era.
Model inversion attacks that exploit confidence information and basic countermeasures
Matt Fredrikson, Somesh Jha, and Thomas Ristenpart · 2015
Cited alongside, same era.
Membership inference attacks against machine learning models
Reza Shokri, Marco Stronati, Congzheng Song, and Vitaly Shmatikov · 2017
Later among the works it cites.
Opening the black box of deep neural networks via information
Ravid Shwartz-Ziv and Naftali Tishby · 2017
Later among the works it cites.
Machine learning models that remember too much
Congzheng Song, Thomas Ristenpart, and Vitaly Shmatikov · 2017
Later among the works it cites.
Automated crowdturfing attacks and defenses in online review systems
Yuanshun Yao, Bimal Viswanath, Jenna Cryan, Haitao Zheng, and Ben Y Zhao · 2017
Later among the works it cites.
Scaling SGD batch size to 32k for ImageNet training
Yang You, Igor Gitman, and Boris Ginsburg · 2017
Later among the works it cites.
Understanding deep learning requires rethinking generalization
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Adam: A method for stochastic optimization
Diederik Kingma and Jimmy Ba · 2015
Cited alongside, same era.
Deep learning with differential privacy
Martín Abadi, Andy Chu, Ian Goodfellow, H Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang · 2016
Cited alongside, same era.
Quasi-recurrent neural networks
James Bradbury, Stephen Merity, Caiming Xiong, and Richard Socher · 2016
Cited alongside, same era.
Deep learning
Ian Goodfellow, Yoshua Bengio, Aaron Courville, and Yoshua Bengio · 2016
Cited alongside, same era.
Quantized neural networks: Training neural networks with low precision weights and activations
I Hubara, M Courbariaux, D Soudry, R El-Yaniv, and Y Bengio · 2016
Cited alongside, same era.
Stealing machine learning models via prediction APIs
Florian Tramèr, Fan Zhang, Ari Juels, Michael K Reiter, and Thomas Ristenpart · 2016
Cited alongside, same era.
Google’s neural machine translation system: Bridging the gap between human and machine translation
Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, et al · 2016
Cited alongside, same era.
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals · 2017
Later among the works it cites.
Privacy amplification by iteration
Vitaly Feldman, Ilya Mironov, Kunal Talwar, and Abhradeep Thakurta · 2018
Closest in time.
LOGAN: Evaluating privacy leakage of generative models using generative adversarial networks
Jamie Hayes, Luca Melis, George Danezis, and Emiliano De Cristofaro · 2018
Closest in time.
An analysis of neural language modeling at multiple scales
Stephen Merity, Nitish Shirish Keskar, and Richard Socher · 2018
Closest in time.
Machine learning with membership privacy using adversarial regularization
Milad Nasr, Reza Shokri, and Amir Houmansadr · 2018
Closest in time.
Towards reverse-engineering black-box neural networks
Seong Joon Oh, Max Augustin, Mario Fritz, and Bernt Schiele · 2018
Closest in time.
The natural auditor: How to tell if someone used your words to train their model
Congzheng Song and Vitaly Shmatikov · 2018
Closest in time.
Towards demystifying membership inference attacks
Stacey Truex, Ling Liu, Mehmet Emre Gursoy, Lei Yu, and Wenqi Wei · 2018
Closest in time.
Stealing hyperparameters in machine learning
Binghui Wang and Neil Zhenqiang Gong · 2018
Closest in time.
Privacy risk in machine learning: Analyzing the connection to overfitting
Samuel Yeom, Irene Giacomelli, Matt Fredrikson, and Somesh Jha · 2018
Closest in time.
Gmail smart compose: Real-time assisted writing
Mia Xu Chen, Benjamin N Lee, Gagan Bansal, Yuan Cao, Shuyuan Zhang, Justin Lu, Jackie Tsay, Yinan Wang, Andrew M Dai, Zhifeng Chen, et al · 2019
Closest in time.
Amplification by shuffling: From local to central differential privacy via anonymity
Úlfar Erlingsson, Vitaly Feldman, Ilya Mironov, Ananth Raghunathan, Kunal Talwar, and Abhradeep Thakurta · 2019
Closest in time.
Evaluating differentially private machine learning in practice
Bargav Jayaraman and David Evans · 2019
Closest in time.
Predictive models
Randall Munroe · 2019
Closest in time.