Fetching the paper…
Reading the bibliography…
State-of-the-art approaches for training Differentially Private (DP) Deep Neural Networks (DNN) face difficulties to estimate tight bounds on the sensitivity of the network's layers, and instead rely on a process of per-sample gradient clipping.
Lectures on geometric measure theory
Leon Simon et al · 1983
Earlier work this paper cites.
On the method of bounded differences
Colin McDiarmid et al · 1989
Earlier work this paper cites.
What every computer scientist should know about floating-point arithmetic
David Goldberg · 1991
Earlier work this paper cites.
Learning long-term dependencies with gradient descent is difficult
Yoshua Bengio, Patrice Simard, and Paolo Frasconi · 1994
Earlier work this paper cites.
Stability and generalization
Olivier Bousquet and André Elisseeff · 2002
Earlier work this paper cites.
Convex optimization
Stephen P Boyd and Lieven Vandenberghe · 2004
Earlier work this paper cites.
Calibrating noise to sensitivity in private data analysis
Cynthia Dwork, Frank McSherry, Kobbi Nissim, and Adam Smith · 2006
Earlier work this paper cites.
Optimization algorithms on matrix manifolds
P-A Absil, Robert Mahony, and Rodolphe Sepulchre · 2008
Earlier work this paper cites.
Optimal transport: old and new , volume 338
Cédric Villani · 2008
Earlier work this paper cites.
Differential privacy: on the trade-off between utility and information leakage
Mário S Alvim, Miguel E Andrés, Konstantinos Chatzikokolakis, Pierpaolo Degano, and Catuscia Palamidessi · 2012
Earlier work this paper cites.
Practical bayesian optimization of machine learning algorithms
Jasper Snoek, Hugo Larochelle, and Ryan P Adams · 2012
Earlier work this paper cites.
Concentration inequalities: A nonasymptotic theory of independence
Stéphane Boucheron, Gábor Lugosi, and Pascal Massart · 2013
Earlier work this paper cites.
Gpudet: a deterministic gpu architecture
Hadi Jooybar, Wilson WL Fung, Mike O’Connor, Joseph Devietti, and Tor M Aamodt · 2013
Earlier work this paper cites.
On the difficulty of training recurrent neural networks
Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio · 2013
Earlier work this paper cites.
The algorithmic foundations of differential privacy
Cynthia Dwork, Aaron Roth, et al · 2014
Earlier work this paper cites.
Intriguing properties of neural networks
Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus · 2014
Earlier work this paper cites.
Convex optimization: Algorithms and complexity
Sébastien Bubeck et al · 2015
Earlier work this paper cites.
Deep learning with differential privacy
Martin Abadi, Andy Chu, Ian Goodfellow, H Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang · 2016
Earlier work this paper cites.
Wasserstein generative adversarial networks
Martin Arjovsky, Soumith Chintala, and Léon Bottou · 2017
Earlier work this paper cites.
Spectrally-normalized margin bounds for neural networks
Peter L Bartlett, Dylan J Foster, and Matus Telgarsky · 2017
Earlier work this paper cites.
Parseval networks: Improving robustness to adversarial examples
Moustapha Cisse, Piotr Bojanowski, Edouard Grave, Yann Dauphin, and Nicolas Usunier · 2017
Earlier work this paper cites.
Improved training of wasserstein gans
Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron C Courville · 2017
Earlier work this paper cites.
Hyperband: A novel bandit-based approach to hyperparameter optimization
Lisha Li, Kevin Jamieson, Giulia DeSalvo, Afshin Rostamizadeh, and Ameet Talwalkar · 2017
Earlier work this paper cites.
Efficient orthogonal parametrisation of recurrent neural networks using householder reflections
Zakaria Mhammedi, Andrew Hellicar, Ashfaqur Rahman, and James Bailey · 2017
Earlier work this paper cites.
Rényi differential privacy
Ilya Mironov · 2017
Earlier work this paper cites.
Membership inference attacks against machine learning models
Reza Shokri, Marco Stronati, Congzheng Song, and Vitaly Shmatikov · 2017
Earlier work this paper cites.
Spectral norm regularization for improving the generalizability of deep learning
Yuichi Yoshida and Takeru Miyato · 2017
Earlier work this paper cites.
Privacy amplification by subsampling: Tight analyses via couplings and divergences
Borja Balle, Gilles Barthe, and Marco Gaboardi · 2018
Cited alongside, same era.
Learning differentially private recurrent language models
H Brendan McMahan, Daniel Ramage, Kunal Talwar, and Li Zhang · 2018
Cited alongside, same era.
Spectral normalization for generative adversarial networks
Takeru Miyato, Toshiki Kataoka, Masanori Koyama, and Yuichi Yoshida · 2018
Cited alongside, same era.
Lipschitz regularity of deep neural networks: analysis and efficient estimation
Aladin Virmaux and Kevin Scaman · 2018
Cited alongside, same era.
Privacy risk in machine learning: Analyzing the connection to overfitting
Samuel Yeom, Irene Giacomelli, Matt Fredrikson, and Somesh Jha · 2018
Cited alongside, same era.
Systematic evaluation of privacy risks of machine learning models
Liwei Song and Prateek Mittal · 2021
Later among the works it cites.
Approximating lipschitz continuous functions with groupsort neural networks
Ugo Tanielian and Gerard Biau · 2021
Later among the works it cites.
Mlp-mixer: An all-mlp architecture for vision
Ilya O Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Thomas Unterthiner, Jessica Yung, Andreas Steiner, Daniel Keysers, Jakob Uszkoreit, et al · 2021
Later among the works it cites.
Differentially private learning needs better features (or much more data), 2021
Florian Tramer and Dan Boneh · 2021
Later among the works it cites.
Orthogonalizing convolutional layers with the cayley transform
Asher Trockman and J Zico Kolter · 2021
Later among the works it cites.
An automatic differentiation system for the age of differential privacy
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Huan Zhang, Tsui-Wei Weng, Pin-Yu Chen, Cho-Jui Hsieh, and Luca Daniel · 2018
Cited alongside, same era.
Sorting out lipschitz function approximation
Cem Anil, James Lucas, and Roger Grosse · 2019
Cited alongside, same era.
Certified adversarial robustness via randomized smoothing
Jeremy Cohen, Elan Rosenfeld, and Zico Kolter · 2019
Cited alongside, same era.
Efficient and accurate estimation of lipschitz constants for deep neural networks
Mahyar Fazlyab, Alexander Robey, Hamed Hassani, Manfred Morari, and George Pappas · 2019
Cited alongside, same era.
Réenyi differential privacy of the sampled gaussian mechanism
Ilya Mironov, Kunal Talwar, and Li Zhang · 2019
Cited alongside, same era.
Exploring the use of lipschitz neural networks for automating the design of differentially private mechanisms
Yonadav Shavit and Boriana Gjura · 2019
Cited alongside, same era.
An abstract domain for certifying neural networks
Gagandeep Singh, Timon Gehr, Markus Püschel, and Martin Vechev · 2019
Cited alongside, same era.
Dmitrii Usynin, Alexander Ziller, Moritz Knolle, Andrew Trask, Kritika Prakash, Daniel Rueckert, and Georgios Kaissis · 2021
Later among the works it cites.
Opacus: User-friendly differential privacy library in PyTorch
Ashkan Yousefpour, Igor Shilov, Alexandre Sablayrolles, Davide Testuggine, Karthik Prasad, Mani Malek, John Nguyen, Sayan Ghosh, Akash Bharadwaj, Jessica Zhao, Graham Cormode, and Ilya Mironov · 2021
Later among the works it cites.
Alexander Ziller, Dmitrii Usynin, Moritz Knolle, Kritika Prakash, Andrew Trask, Rickmer Braren, Marcus Makowski, Daniel Rueckert, and Georgios Kaissis · 2021
Later among the works it cites.
Existence, stability and scalability of orthogonal convolutional neural networks
El Mehdi Achour, François Malgouyres, and Franck Mamalet · 2022
Later among the works it cites.
Pay attention to your loss : understanding misconceptions about lipschitz neural networks
Louis Béthune, Thibaut Boissin, Mathieu Serrurier, Franck Mamalet, Corentin Friedrich, and Alberto Gonzalez Sanz · 2022
Later among the works it cites.
Unlocking high-accuracy differentially private image classification through scale
Soham De, Leonard Berrada, Jamie Hayes, Samuel L Smith, and Borja Balle · 2022
Later among the works it cites.
Revisiting hyperparameter tuning with differential privacy
Youlong Ding and Xueyang Wu · 2022
Later among the works it cites.
Adbench: Anomaly detection benchmark
Songqiao Han, Xiyang Hu, Hailiang Huang, Mingqi Jiang, and Yue Zhao · 2022
Later among the works it cites.
Exploring the limits of differentially private deep learning with group-wise clipping
Jiyan He, Xuechen Li, Da Yu, Huishuai Zhang, Janardhan Kulkarni, Yin Tat Lee, Arturs Backurs, Nenghai Yu, and Jiang Bian · 2022
Later among the works it cites.
A dynamical system perspective for lipschitz neural networks
Laurent Meunier, Blaise J Delattre, Alexandre Araujo, and Alexandre Allauzen · 2022
Later among the works it cites.
Hyperparameter tuning with renyi differential privacy
Nicolas Papernot and Thomas Steinke · 2022
Later among the works it cites.
Tan without a burn: Scaling laws of dp-sgd
Tom Sander, Pierre Stock, and Alexandre Sablayrolles · 2022
Later among the works it cites.
Improved techniques for deterministic l2 robustness
Sahil Singla and Soheil Feizi · 2022
Later among the works it cites.
Dp-sgd-lf: Improving utility under differentially private learning via layer freezing
Qiaoyue Tang and Mathias Lécuyer · 2022
Later among the works it cites.
Numerical linear algebra , volume 181
Lloyd N Trefethen and David Bau · 2022
Later among the works it cites.
Lot: Layer-wise orthogonal training on improving l2 certified robustness
Xiaojun Xu, Linyi Li, and Bo Li · 2022
Later among the works it cites.
Normalized/clipped sgd with perturbation for differentially private non-convex optimization
Xiaodong Yang, Huishuai Zhang, Wei Chen, and Tie-Yan Liu · 2022
Later among the works it cites.
Differentially private optimization on large model at small cost
Zhiqi Bu, Yu-Xiang Wang, Sheng Zha, and George Karypis · 2023
Closest in time.
How to dp-fy ml: A practical guide to machine learning with differential privacy
Natalia Ponomareva, Hussein Hazimeh, Alex Kurakin, Zheng Xu, Carson Denison, H Brendan McMahan, Sergei Vassilvitskii, Steve Chien, and Abhradeep Thakurta · 2023
Closest in time.
Direct parameterization of lipschitz-bounded deep networks
Ruigang Wang and Ian Manchester · 2023
Closest in time.
Augment then smooth: Reconciling differential privacy with certified robustness
Jiapeng Wu, Atiyeh Ashari Ghomi, David Glukhov, Jesse C Cresswell, Franziska Boenisch, and Nicolas Papernot · 2023
Closest in time.