Fetching the paper…
Reading the bibliography…
We describe a limitation in the expressiveness of the predictive uncertainty estimate given by mean-field variational inference (MFVI), a popular approximate inference method for Bayesian neural networks.
Transforming neural-net output levels to probability distributions
Denker, J. S. and LeCun, Y · 1991
Earlier work this paper cites.
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C · 1992
Earlier work this paper cites.
Keeping neural networks simple by minimizing the description length of the weights
Hinton, G. and Van Camp, D · 1993
Earlier work this paper cites.
Ensemble learning in Bayesian neural networks
Barber, D. and Bishop, C. M · 1998
Earlier work this paper cites.
Variational inference in probabilistic models
Lawrence, N. D · 2001
Earlier work this paper cites.
Kernel methods for deep learning
Cho, Y. and Saul, L. K · 2009
Earlier work this paper cites.
Bayesian learning for neural networks , volume 118
Neal, R. M · 2012
Earlier work this paper cites.
Adam: A method for stochastic optimization
Kingma, D. P. and Ba, J · 2014
Earlier work this paper cites.
Weight uncertainty in neural network
Blundell, C., Cornebise, J., Kavukcuoglu, K., and Wierstra, D · 2015
Earlier work this paper cites.
Black-box stochastic variational inference in five lines of Python
Duvenaud, D. and Adams, R. P · 2015
Cited alongside, same era.
Probabilistic backpropagation for scalable learning of Bayesian neural networks
Hernández-Lobato, J. M. and Adams, R · 2015
Cited alongside, same era.
Variational dropout and the local reparameterization trick
Kingma, D. P., Salimans, T., and Welling, M · 2015
Cited alongside, same era.
Scalable Bayesian optimization using deep neural networks
Snoek, J., Rippel, O., Swersky, K., Kiros, R., Satish, N., Sundaram, N., Patwary, M., Prabhat, M., and Adams, R · 2015
Cited alongside, same era.
Deep Gaussian processes for regression using approximate expectation propagation
Bui, T., Hernández-Lobato, D., Hernandez-Lobato, J., Li, Y., and Turner, R · 2016
Cited alongside, same era.
Uncertainty in deep learning
Gal, Y · 2016
Simple and scalable predictive uncertainty estimation using deep ensembles
Lakshminarayanan, B., Pritzel, A., and Blundell, C · 2017
Later among the works it cites.
Deep neural networks as Gaussian processes
Lee, J., Bahri, Y., Novak, R., Schoenholz, S. S., Pennington, J., and Sohl-Dickstein, J · 2017
Later among the works it cites.
Overpruning in variational Bayesian neural networks
Trippe, B. and Turner, R. E · 2017
Later among the works it cites.
Deep reinforcement learning in a handful of trials using probabilistic dynamics models
Chua, K., Calandra, R., McAllister, R., and Levine, S · 2018
Later among the works it cites.
On the importance of strong baselines in Bayesian deep learning
Mukhoti, J., Stenetorp, P., and Gal, Y · 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Dropout as a Bayesian approximation: Representing model uncertainty in deep learning
Gal, Y. and Ghahramani, Z · 2016
Cited alongside, same era.
Deep Bayesian active learning with image data
Gal, Y., Islam, R., and Ghahramani, Z · 2017
Cited alongside, same era.
Later among the works it cites.
Riquelme, C., Tucker, G., and Snoek, J · 2018
Later among the works it cites.
A scalable Laplace approximation for neural networks
Ritter, H., Botev, A., and Barber, D · 2018
Later among the works it cites.
Neural network ensembles and variational inference revisited
Tomczak, M. B., Swaroop, S., and Turner, R. E · 2018
Later among the works it cites.