Multiple Testing Framework for Out-of-Distribution Detection

S. Holm, “A simple sequentially rejective multiple test procedure,” Scandinavian Journal of Statistics , vol. 6, no. 2, pp. 65–70, 1979. [Online]. Available: http://www.jstor.org/stable/4615733

1979

Earlier work this paper cites.

R. J. Simes, “An improved bonferroni procedure for multiple tests of significance,” Biometrika , vol. 73, no. 3, pp. 751–754, 1986

1986

Earlier work this paper cites.

R. A. Fisher, Statistical methods for research workers . Springer, 1992

1992

Earlier work this paper cites.

Y. Benjamini and Y. Hochberg, “Controlling the false discovery rate: A practical and powerful approach to multiple testing,” Journal of the Royal Statistical Society. Series B (Methodological) , vol. 57, no. 1, pp. 289–300, 1995. [Online]. Available: http://www.jstor.org/stable/2346101

1995

Earlier work this paper cites.

Y. Benjamini and Y. Hochberg, “Controlling the false discovery rate: a practical and powerful approach to multiple testing,” Journal of the Royal statistical society: series B (Methodological) , vol. 57, no. 1, pp. 289–300, 1995

1995

Earlier work this paper cites.

V. Vovk, A. Gammerman, and C. Saunders, “Machine-learning applications of algorithmic randomness,” in Proceedings of the Sixteenth International Conference on Machine Learning , ser. ICML ’99. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 1999, p. 444–453

1999

Earlier work this paper cites.

Y. Benjamini and D. Yekutieli, “The control of the false discovery rate in multiple testing under dependency,” The Annals of Statistics , vol. 29, no. 4, pp. 1165–1188, 2001. [Online]. Available: http://www.jstor.org/stable/2674075

2001

Earlier work this paper cites.

V. Vovk, “Conditional validity of inductive conformal predictors,” in Asian conference on machine learning . PMLR, 2012, pp. 475–490

2012

Earlier work this paper cites.

V. Vovk, “Conditional validity of inductive conformal predictors,” in Proceedings of the Asian Conference on Machine Learning , ser. Proceedings of Machine Learning Research, S. C. H. Hoi and W. Buntine, Eds., vol. 25. Singapore Management University, Singapore: PMLR, 04–06 Nov 2012, pp. 475–490. [Online]. Available: https://proceedings.mlr.press/v25/vovk12.html

2012

Earlier work this paper cites.

C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, and R. Fergus, “Intriguing properties of neural networks,” arXiv preprint arXiv:1312.6199 , 2013

Original

2013

Earlier work this paper cites.

V. Balasubramanian, S.-S. Ho, and V. Vovk, Conformal Prediction for Reliable Machine Learning: Theory, Adaptations and Applications , 1st ed. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 2014

2014

Cited alongside, same era.

A. Nguyen, J. Yosinski, and J. Clune, “Deep neural networks are easily fooled: High confidence predictions for unrecognizable images,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2015, pp. 427–436

2015

Cited alongside, same era.

D. Hendrycks and K. Gimpel, “A baseline for detecting misclassified and out-of-distribution examples in neural networks,” arXiv preprint arXiv:1610.02136 , 2016

Original

2016

Cited alongside, same era.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 770–778

2016

Cited alongside, same era.

R. Huang, A. Geng, and Y. Li, “On the importance of gradients for detecting distributional shifts in the wild,” in Advances in Neural Information Processing Systems , M. Ranzato, A. Beygelzimer, Y. Dauphin, P. Liang, and J. W. Vaughan, Eds., vol. 34. Curran Associates, Inc., 2021, pp. 677–689. [Online]. Available: https://proceedings.neurips.cc/paper/2021/file/063e26c670d07bb7c4d30e6fc69fe056-Paper.pdf

2021

Later among the works it cites.

A. N. Angelopoulos, S. Bates, E. J. Candès, M. I. Jordan, and L. Lei, “Learn then test: Calibrating predictive algorithms to achieve risk control,” arXiv preprint arXiv:2110.01052 , 2021

Original

2021

Later among the works it cites.

M. Haroush, T. Frostig, R. Heller, and D. Soudry, “A statistical framework for efficient out of distribution detection in deep neural networks,” arXiv preprint arXiv:2102.12967 , 2021

Original

2021

Later among the works it cites.

L. Zhang, M. Goldstein, and R. Ranganath, “Understanding failures in out-of-distribution detection with deep generative models,” in International Conference on Machine Learning . PMLR, 2021, pp. 12 427–12 436