Fetching the paper…
Reading the bibliography…
We challenge the longstanding assumption that the mean-field approximation for variational inference in Bayesian neural networks is severely restrictive, and show this is not the case in deep networks.
The Distribution of Products of Beta, Gamma and Gaussian Random Variables
M. D. Springer and W. E. Thompson · 1970
Earlier work this paper cites.
Principles of Mathematical Analysis
Walter Rudin · 1976
Earlier work this paper cites.
A Practical Bayesian Framework for Backpropagation Networks
David J. C. MacKay · 1992
Earlier work this paper cites.
Noisy Natural Gradient as Variational Inference
Guodong Zhang, Shengyang Sun, David Duvenaud, and Roger Grosse · 1992
Earlier work this paper cites.
Keeping Neural Networks Simple by Minimizing the Description Length of the Weights
Geoffrey Hinton and Drew van Camp · 1993
Earlier work this paper cites.
Multilayer feedforward networks with a nonpolynomial activation function can approximate any function
Moshe Leshno, Vladimir Ya. Lin, Allan Pinkus, and Shimon Schocken · 1993
Earlier work this paper cites.
Bayesian Learning for Neural Networks
Radford M. Neal · 1995
Earlier work this paper cites.
Ensemble Learning in Bayesian Neural Networks
David Barber and Christopher M Bishop · 1998
Earlier work this paper cites.
Improving the Mean Field Approximation Via the Use of Mixture Distributions
Tommi S. Jaakkola and Michael I. Jordan · 1998
Earlier work this paper cites.
Practical Variational Inference for Neural Networks
Alex Graves · 2011
Earlier work this paper cites.
Entropy and Information Theory
Robert M. Gray · 2011
Earlier work this paper cites.
The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
Matthew D Hoffman and Andrew Gelman · 2014
Earlier work this paper cites.
Neural Variational Inference and Learning in Belief Networks
Andriy Mnih and Karol Gregor · 2014
Earlier work this paper cites.
On the Number of Linear Regions of Deep Neural Networks
Guido Montúfar, Razvan Pascanu, Kyunghyun Cho, and Yoshua Bengio · 2014
Cited alongside, same era.
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks
A. M. Saxe, J. L. McClelland, and S Ganguli · 2014
Cited alongside, same era.
Weight Uncertainty in Neural Networks
Charles Blundell, Julien Cornebise, Koray Kavukcuoglu, and Daan Wierstra · 2015
Cited alongside, same era.
A Class of Probability Distributions that is Closed with Respect to Addition as Well as Multiplication of Independent Random Variables
Lennart Bondesson · 2015
Cited alongside, same era.
Variational Inference with Normalizing Flows
Danilo Jimenez Rezende and Shakir Mohamed · 2015
Cited alongside, same era.
Uncertainty in Deep Learning
Yarin Gal · 2016
Cited alongside, same era.
Introducing an Explicit Symplectic Integration Scheme for Riemannian Manifold Hamiltonian Monte Carlo
Adam D. Cobb, Atılım Güneş Baydin, Andrew Markham, and Stephen J. Roberts · 2019
Later among the works it cites.
Truth or backpropaganda? An empirical investigation of deep learning theory
Micah Goldblum, Jonas Geiping, Avi Schwarzschild, Michael Moeller, and Tom Goldstein · 2019
Later among the works it cites.
A Simple Baseline for Bayesian Uncertainty in Deep Learning
Wesley Maddox, Timur Garipov, Pavel Izmailov, Dmitry Vetrov, and Andrew Gordon Wilson · 2019
Later among the works it cites.
SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient
Aaron Mishkin, Frederik Kunstner, Didrik Nielsen, Mark Schmidt, and Mohammad Emtiyaz Khan · 2019
Later among the works it cites.
Radial and Directional Posteriors for Bayesian Neural Networks
Changyong Oh, Kamil Adamczewski, and Mijung Park · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Cited alongside, same era.
Structured and Efficient Variational Deep Learning with Matrix Gaussian Posteriors
Christos Louizos and Max Welling · 2016
Cited alongside, same era.
Multiplicative Normalizing Flows for Variational Bayesian Neural Networks
Christos Louizos and Max Welling · 2017
Cited alongside, same era.
Fashion-MNIST: A Novel Image Dataset for Benchmarking Machine Learning Algorithms
Han Xiao, Kashif Rasul, and Roland Vollgraf · 2017
Cited alongside, same era.
Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam
Mohammad Emtiyaz Khan, Didrik Nielsen, Voot Tangkaratt, Wu Lin, Yarin Gal, and Akash Srivastava · 2018
Cited alongside, same era.
On the Convergence of Adam and Beyond
Sashank J. Reddi, Satyen Kale, and Sanjiv Kumar · 2018
Cited alongside, same era.
Practical Deep Learning with Bayesian Principles
Kazuki Osawa, Siddharth Swaroop, Anirudh Jain, Runa Eschenhagen, Richard E. Turner, Rio Yokota, and Mohammad Emtiyaz Khan · 2019
Later among the works it cites.
A Simple Explanation for the Existence of Adversarial Examples with Small Hamming Distance
Adi Shamir, Itay Safran, Eyal Ronen, and Orr Dunkelman · 2019
Later among the works it cites.
Functional variational Bayesian Neural Networks
Shengyang Sun, Guodong Zhang, Jiaxin Shi, and Roger Grosse · 2019
Later among the works it cites.
Deterministic Variational Inference for Robust Bayesian Neural Networks
Anqi Wu, Sebastian Nowozin, Edward Meeds, Richard E Turner, Jose Miguel Hernandez-Lobato, and Alexander L Gaunt · 2019
Later among the works it cites.
Radial Bayesian Neural Networks: Robust Variational Inference In Big Models
Sebastian Farquhar, Michael Osborne, and Yarin Gal · 2020
Closest in time.
On the Expressiveness of Approximate Inference in Bayesian Neural Networks
Andrew Y. K. Foong, David R. Burt, Yingzhen Li, and Richard E. Turner · 2020
Closest in time.
The k-tied Normal Distribution: A Compact Parameterization of Gaussian Mean Field Posteriors in Bayesian Neural Networks
Jakub Swiatkowski, Kevin Roth, Bastiaan S. Veeling, Linh Tran, Joshua V. Dillon, Jasper Snoek, Stephan Mandt, Tim Salimans, Rodolphe Jenatton, and Sebastian Nowozin · 2020
Closest in time.