Efficient Evaluation-Time Uncertainty Estimation by Improved Distillation

Crafting papers on machine learning

Langley, P · 2000

Earlier work this paper cites.

Practical variational inference for neural networks

Graves, A · 2011

Earlier work this paper cites.

Bayesian learning via stochastic gradient langevin dynamics

Welling, M. and Teh, Y. W · 2011

Earlier work this paper cites.

Bayesian dark knowledge

Balan, A. K., Rathod, V., Murphy, K. P., and Welling, M · 2015

Earlier work this paper cites.

Probabilistic backpropagation for scalable learning of bayesian neural networks

Hernández-Lobato, J. M. and Adams, R · 2015

Earlier work this paper cites.

Distilling the knowledge in a neural network

Original

Hinton, G., Vinyals, O., and Dean, J · 2015

Earlier work this paper cites.

Dropout as a bayesian approximation: Representing model uncertainty in deep learning

Gal, Y. and Ghahramani, Z · 2016

Earlier work this paper cites.

Identity mappings in deep residual networks

Original

He, K., Zhang, X., Ren, S., and Sun, J · 2016

Cited alongside, same era.

Selective classification for deep neural networks

Geifman, Y. and El-Yaniv, R · 2017

Cited alongside, same era.

On calibration of modern neural networks

Guo, C., Pleiss, G., Sun, Y., and Weinberger, K. Q · 2017

Cited alongside, same era.

Snapshot ensembles: Train 1, get M for free

Huang, G., Li, Y., Pleiss, G., Liu, Z., Hopcroft, J. E., and Weinberger, K. Q · 2017

Cited alongside, same era.

Simple and scalable predictive uncertainty estimation using deep ensembles

Lakshminarayanan, B., Pritzel, A., and Blundell, C · 2017

Cited alongside, same era.

Large scale distributed neural network training through online distillation

Anil, R., Pereyra, G., Passos, A., Ormándi, R., Dahl, G. E., and Hinton, G. E · 2018

Meta-learning for stochastic gradient mcmc

Original

Gong, W., Li, Y., and Hernández-Lobato, J. M · 2018

Later among the works it cites.

Dropout distillation for efficiently estimating model confidence

Original

Gurau, C., Bewley, A., and Posner, I · 2018

Later among the works it cites.

Reducing overconfident errors outside the known distribution

Li, Z. and Hoiem, D · 2018

Later among the works it cites.

Bayesian uncertainty estimation for batch normalized deep networks

Teye, M., Azizpour, H., and Smith, K · 2018

Later among the works it cites.

Discrimination-aware channel pruning for deep neural networks

Original

Zhuang, Z., Tan, M., Zhuang, B., Liu, J., Guo, Y., Wu, Q., Huang, J., and Zhu, J · 2018

Later among the works it cites.