Fetching the paper…
Reading the bibliography…
Deep neural networks are prone to overconfident predictions on outliers.
Verification of forecasts expressed in terms of probability
G. W. Brier · 1950
Earlier work this paper cites.
Backpropagation applied to handwritten zip code recognition
Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel · 1989
Earlier work this paper cites.
A practical Bayesian framework for backpropagation networks
D. J. MacKay · 1992
Earlier work this paper cites.
Bayesian Learning for Neural Networks
R. M. Neal · 1996
Earlier work this paper cites.
Bayesian Gaussian processes for regression and classification
M. N. Gibbs · 1998
Earlier work this paper cites.
Dataset Shift in Machine Learning
J. Quionero-Candela, M. Sugiyama, A. Schwaighofer, and N. D. Lawrence · 2009
Earlier work this paper cites.
Practical variational inference for neural networks
A. Graves · 2011
Earlier work this paper cites.
Bayesian learning via stochastic gradient Langevin dynamics
M. Welling and Y. W. Teh · 2011
Earlier work this paper cites.
Weight uncertainty in neural network
C. Blundell, J. Cornebise, K. Kavukcuoglu, and D. Wierstra · 2015
Earlier work this paper cites.
Adam: A method for stochastic optimization
D. P. Kingma and J. Ba · 2015
Earlier work this paper cites.
Optimizing neural networks with Kronecker-factored approximate curvature
J. Martens and R. B. Grosse · 2015
Earlier work this paper cites.
Obtaining well calibrated probabilities using Bayesian binning
M. P. Naeini, G. F. Cooper, and M. Hauskrecht · 2015
Earlier work this paper cites.
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
A. M. Nguyen, J. Yosinski, and J. Clune · 2015
Earlier work this paper cites.
Scalable Bayesian optimization using deep neural networks
J. Snoek, O. Rippel, K. Swersky, R. Kiros, N. Satish, N. Sundaram, M. M. A. Patwary, Prabhat, and R. P. Adams · 2015
Earlier work this paper cites.
Concrete problems in AI safety
D. Amodei, C. Olah, J. Steinhardt, P. F. Christiano, J. Schulman, and D. Mané · 2016
Earlier work this paper cites.
Wide residual networks
S. Zagoruyko and N. Komodakis · 2016
Earlier work this paper cites.
On calibration of modern neural networks
C. Guo, G. Pleiss, Y. Sun, and K. Q. Weinberger · 2017
Earlier work this paper cites.
A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks
D. Hendrycks and K. Gimpel · 2017
Earlier work this paper cites.
Simple and scalable predictive uncertainty estimation using deep ensembles
B. Lakshminarayanan, A. Pritzel, and C. Blundell · 2017
Cited alongside, same era.
SGDR: stochastic gradient descent with warm restarts
I. Loshchilov and F. Hutter · 2017
Cited alongside, same era.
Understanding deep neural networks with rectified linear units
R. Arora, A. Basu, P. Mianjy, and A. Mukherjee · 2018
Cited alongside, same era.
Fast and scalable Bayesian deep learning by weight-perturbation in adam
M. E. Khan, D. Nielsen, V. Tangkaratt, W. Lin, Y. Gal, and A. Srivastava · 2018
Cited alongside, same era.
Deep Bayesian bandits showdown: An empirical comparison of Bayesian deep networks for Thompson sampling
C. Riquelme, G. Tucker, and J. Snoek · 2018
Cited alongside, same era.
A scalable Laplace approximation for neural networks
H. Ritter, A. Botev, and D. Barber · 2018
Pytorch: An imperative style, high-performance deep learning library
A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga, A. Desmaison, A. Kopf, E. Yang, Z. DeVito, M. Raison, A. Tejani, S. Chilamkurthy, B. Steiner, L. Fang, J. Bai, and S. Chintala · 2019
Later among the works it cites.
Bayesian batch active learning as sparse subset approximation
R. Pinsler, J. Gordon, E. T. Nalisnick, and J. M. Hernández-Lobato · 2019
Later among the works it cites.
Pitfalls of in-domain uncertainty estimation and ensembling in deep learning
A. Ashukha, A. Lyzhov, D. Molchanov, and D. P. Vetrov · 2020
Later among the works it cites.
On last-layer algorithms for classification: Decoupling representation from uncertainty estimation
N. Brosse, C. Riquelme, A. Martin, S. Gelly, and É. Moulines · 2020
Later among the works it cites.
BackPACK: Packing more into backprop
F. Dangel, F. Kunstner, and P. Hennig · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Noisy natural gradient as variational inference
G. Zhang, S. Sun, D. Duvenaud, and R. B. Grosse · 2018
Cited alongside, same era.
A systematic comparison of bayesian deep learning robustness in diabetic retinopathy tasks
A. Filos, S. Farquhar, A. N. Gomez, T. G. J. Rudner, Z. Kenton, L. Smith, M. Alizadeh, A. D. Kroon, and Y. Gal · 2019
Cited alongside, same era.
’in-between’ uncertainty in Bayesian neural networks
A. Y. K. Foong, Y. Li, J. M. Hernández-Lobato, and R. Turner · 2019
Cited alongside, same era.
Deep ensembles: A loss landscape perspective
S. Fort, H. Hu, and B. Lakshminarayanan · 2019
Cited alongside, same era.
Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem
M. Hein, M. Andriushchenko, and J. Bitterwolf · 2019
Cited alongside, same era.
Benchmarking neural network robustness to common corruptions and perturbations
D. Hendrycks and T. G. Dietterich · 2019
Cited alongside, same era.
Efficient and scalable Bayesian neural nets with rank-1 factors
M. Dusenberry, G. Jerfel, Y. Wen, Y. Ma, J. Snoek, K. A. Heller, B. Lakshminarayanan, and D. Tran · 2020
Later among the works it cites.
Improving predictions of Bayesian neural networks via local linearization
A. Immer, M. Korzepa, and M. Bauer · 2020
Later among the works it cites.
Being Bayesian, even just a bit, fixes overconfidence in ReLU networks
A. Kristiadi, M. Hein, and P. Hennig · 2020
Later among the works it cites.
Simple and principled uncertainty estimation with deterministic deep learning via distance awareness
J. Z. Liu, Z. Lin, S. Padhy, D. Tran, T. Bedrax-Weiss, and B. Lakshminarayanan · 2020
Later among the works it cites.
On power laws in deep ensembles, 2020
E. Lobacheva, N. Chirkova, M. Kodryan, and D. Vetrov · 2020
Later among the works it cites.
Uncertainty quantification and deep ensembles
R. Rahaman and A. H. Thiery · 2020
Later among the works it cites.
Combining ensembles and data augmentation can harm your calibration
Y. Wen, G. Jerfel, R. Muller, M. W. Dusenberry, J. Snoek, B. Lakshminarayanan, and D. Tran · 2020
Later among the works it cites.
Bayesian deep learning and a probabilistic perspective of generalization
A. G. Wilson and P. Izmailov · 2020
Later among the works it cites.
Cyclical stochastic gradient MCMC for Bayesian deep learning
R. Zhang, C. Li, J. Zhang, C. Chen, and A. G. Wilson · 2020
Later among the works it cites.
Training independent subnetworks for robust prediction
M. Havasi, R. Jenatton, S. Fort, J. Z. Liu, J. Snoek, B. Lakshminarayanan, A. M. Dai, and D. Tran · 2021
Closest in time.
Scalable marginal likelihood estimation for model selection in deep learning
A. Immer, M. Bauer, V. Fortuin, G. Rätsch, and M. E. Khan · 2021
Closest in time.
Mean-field approximation to gaussian-softmax integral with application to uncertainty estimation, 2021
Z. Lu, E. Ie, and F. Sha · 2021
Closest in time.