Fetching the paper…
Reading the bibliography…
With increasing interest in explaining machine learning (ML) models, the first part of this two-part study synthesizes recent research on methods for explaining global and local aspects of ML models.
Molnar, C., G. Casalicchio, and B. Bischl, 2019: Quantifying Model Complexity via Functional Decomposition for Better Post-Hoc Interpretability. arXiv
1904
Earlier work this paper cites.
Hooker, G., and L. Mentch, 2019: Please Stop Permuting Features: An Explanation and Alternatives. arXiv
1905
Earlier work this paper cites.
Shapley, L. S., 1953: A value for n-person games. Contributions to the Theory of Games
1953
Earlier work this paper cites.
Owen, G., 1977: Values of games with a priori unions. Mathematical Economics and Game Theory
1977
Earlier work this paper cites.
Kumler-Bonfanti, C., J. Stewart, D. Hall, and M. Govett, 2020: Tropical and extratropical cyclone detection using deep learning. J. Appl. Meteor. Climatol
1985
Earlier work this paper cites.
Young, H. P., 1985: Monotonic solutions of cooperative games. International Journal of Game Theory
1985
Earlier work this paper cites.
Murphy, A. H., 1993: What Is a Good Forecast? An Essay on the Nature of Goodness in Weather Forecasting. Wea. Forecasting
1993
Earlier work this paper cites.
Breiman, L., 2001: Random forests. Machine Learning
2001
Earlier work this paper cites.
Friedman, J. H., 2001: Greedy Function Approximation: A Gradient Boosting Machine. The Annals of Statistics
2001
Earlier work this paper cites.
Covert, I., S. Lundberg, and S.-I. Lee, 2020: Understanding Global Feature Contributions With Additive Importance Measures. arXiv, 2004.00668
2004
Earlier work this paper cites.
van Lent, M., W. Fisher, and M. Mancuso, 2004: An explainable artificial intelligence system for small-unit tactical behavior. Proceedings of the 16th Conference on Innovative Applications of Artifical Intelligence
2004
Earlier work this paper cites.
van der Laan, M. J., 2006: Statistical inference for variable importance. The International Journal of Biostatistics
2006
Earlier work this paper cites.
König, G., C. Molnar, B. Bischl, and M. Grosse-Wentrup, 2020: Relative Feature Importance. arXiv
2007
Earlier work this paper cites.
Molnar, C., and Coauthors, 2021: General pitfalls of model-agnostic interpretation methods for machine learning models. arXiv, 2007.04131
2007
Earlier work this paper cites.
Strobl, C., A.-L. Boulesteix, A. Zeileis, and T. Hothorn, 2007: Bias in random forest variable importance measures: Illustrations, sources and a solution. BMC Bioinformatics
2007
Earlier work this paper cites.
Friedman, J. H., and B. E. Popescu, 2008: Predictive learning via rule ensembles. The Annals of Applied Statistics
2008
Earlier work this paper cites.
Strobl, C., A.-L. Boulesteix, T. Kneib, T. Augustin, and A. Zeileis, 2008: Conditional variable importance for random forests. BMC Bioinformatics
2008
Earlier work this paper cites.
López, S., and M. Saboya, 2009: On the relationship between Shapley and Owen values. Central European Journal of Operations Research
2009
Earlier work this paper cites.
Roebber, P. J., 2009: Visualizing multiple measures of forecast quality. Wea. Forecasting
2009
Earlier work this paper cites.
Molnar, C., G. Casalicchio, and B. Bischl, 2020: Interpretable Machine Learning – A Brief History, State-of-the-Art and Challenges. arXiv
2010
Earlier work this paper cites.
Pedregosa, F., and Coauthors, 2011: Scikit-learn: Machine learning in python. J. Mach. Learn. Res
2011
Earlier work this paper cites.
Boyd, K., V. S. Costa, J. Davis, and D. Page, 2012: Unachievable Region in Precision-Recall Space and Its Effect on Empirical Evaluation. arXiv
2012
Earlier work this paper cites.
Saabas, A., 2014: Interpreting random forests. URL https://blog.datadive.net/interpreting-random-forests/
2014
Earlier work this paper cites.
Gregorutti, B., B. Michel, and P. Saint-Pierre, 2015: Grouped variable importance with random forests and application to multiple functional data analysis. Computational Statistics & Data Analysis
2015
Earlier work this paper cites.
Lakshmanan, V., C. Karstens, J. Krause, K. Elmore, A. Ryzhkov, and S. Berkseth, 2015: Which Polarimetric Variables Are Important for Weather/No-Weather Discrimination? Journal of Atmospheric and Oceanic Technology
2015
Earlier work this paper cites.
Wheatley, D. M., K. H. Knopfmeier, T. A. Jones, and G. J. Creager, 2015: Storm-Scale Data Assimilation and Ensemble Forecasting with the NSSL Experimental Warn-on-Forecast System. Part I: Radar Data Experiments. Wea. Forecasting
2015
Earlier work this paper cites.
Apley, D. W., and J. Zhu, 2016: Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Models. arXiv
2016
Earlier work this paper cites.
Jones, T. A., K. Knopfmeier, D. Wheatley, G. Creager, P. Minnis, and R. Palikonda, 2016: Storm-Scale Data Assimilation and Ensemble Forecasting with the NSSL Experimental Warn-on-Forecast System Part II: Combined Radar and Satellite Data Experiments. Wea. Forecasting
2016
Earlier work this paper cites.
Kim, B., R. Khanna, and O. O. Koyejo, 2016: Examples are not enough, learn to criticize! criticism for interpretability. Advances in Neural Information Processing Systems
2016
Earlier work this paper cites.
Lipton, Z. C., 2016: The Mythos of Model Interpretability. arXiv
2016
Cited alongside, same era.
Ribeiro, M. T., S. Singh, and C. Guestrin, 2016: Model-Agnostic Interpretability of Machine Learning. arXiv
2016
Cited alongside, same era.
Doshi-Velez, F., and B. Kim, 2017: Towards A Rigorous Science of Interpretable Machine Learning. arXiv
2017
Cited alongside, same era.
Gagne, I., David John, A. McGovern, S. E. Haupt, R. A. Sobash, J. K. Williams, and M. Xue, 2017: Storm-Based Probabilistic Hail Forecasting with Machine Learning Applied to Convection-Allowing Ensembles. Wea. Forecasting
2017
Cited alongside, same era.
Gregorutti, B., B. Michel, and P. Saint-Pierre, 2017: Correlation and variable importance in random forests. Statistics and Computing
2017
Cited alongside, same era.
Hamidi, Y., L. Raynaud, L. Rottner, and P. Arbogast, 2020: Texture-based classification of high-resolution precipitation forecasts with machine-learning methods. Quarterly Journal of the Royal Meteorological Society
2020
Later among the works it cites.
Handler, S. L., H. D. Reeves, and A. McGovern, 2020: Development of a probabilistic subfreezing road temperature nowcast and forecast using machine learning. Wea. Forecasting
2020
Later among the works it cites.
Jergensen, G. E., A. McGovern, R. Lagerquist, and T. Smith, 2020: Classifying Convective Storms Using Machine Learning. Wea. Forecasting
2020
Later among the works it cites.
Jones, T. A., and Coauthors, 2020: Assimilation of GOES-16 Radiances and Retrievals into the Warn-on-Forecast System. Mon. Wea. Rev
2020
Later among the works it cites.
Lagerquist, R., A. McGovern, C. R. Homeyer, I. Gagne, David John, and T. Smith, 2020: Deep Learning on Three-dimensional Multiscale Data for Next-hour Tornado Prediction. Mon. Wea. Rev
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Hoffman, R. R., D. S. LaDue, H. M.Mogil, P. J.Roebber, and J. G.Trafton, 2017: Minding the Weather: How Expert Forecasters Think
2017
Cited alongside, same era.
Lagerquist, R., A. McGovern, and T. Smith, 2017: Machine Learning for Real-Time Prediction of Damaging Straight-Line Convective Wind. Wea. Forecasting
2017
Cited alongside, same era.
Lundberg, S. M., and S.-I. Lee, 2017: A Unified Approach to Interpreting Model Predictions. Advances in Neural Information Processing Systems 30
2017
Cited alongside, same era.
Minokhin, I., C. G. Fletcher, and A. Brenning, 2017: Forecasting northern polar stratospheric variability with competing statistical learning models. Quarterly Journal of the Royal Meteorological Society
2017
Cited alongside, same era.
Adadi, A., and M. Berrada, 2018: Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI). IEEE Access
2018
Cited alongside, same era.
Fisher, A., C. Rudin, and F. Dominici, 2018: All Models are Wrong, but Many are Useful: Learning a Variable’s Importance by Studying an Entire Class of Prediction Models Simultaneously. arXiv
2018
Cited alongside, same era.
Flora, M. L., C. K. Potvin, and L. J. Wicker, 2018: Practical Predictability of Supercells: Exploring Ensemble Forecast Sensitivity to Initial Condition Spread. Mon. Wea. Rev
2018
Cited alongside, same era.
2020
Later among the works it cites.
Linardatos, P., V. Papastefanopoulos, and S. Kotsiantis, 2020: Explainable AI: A Review of Machine Learning Interpretability Methods. Entropy
2020
Later among the works it cites.
Lundberg, S. M., and Coauthors, 2020: From local explanations to global understanding with explainable ai for trees. Nat Mach Intell
2020
Later among the works it cites.
Molnar, C., 2020: Interpretable Machine Learning: A Guide for Making Black Box Models Explainable
2020
Later among the works it cites.
Au, Q., J. Herbinger, C. Stachl, B. Bischl, and G. Casalicchio, 2021: Grouped Feature Importance and Combined Features Effect Plot. arXiv
2021
Later among the works it cites.
Flora, M. L., C. K. Potvin, P. S. Skinner, S. Handler, and A. McGovern, 2021: Using Machine Learning to Generate Storm-Scale Probabilistic Guidance of Severe Weather Hazards in the Warn-on-Forecast System. Mon. Wea. Rev
2021
Later among the works it cites.
Ghassemi, M., L. Oakden-Rayner, and A. L. Beam, 2021: The false hope of current approaches to explainable artificial intelligence in health care. The Lancet Digital Health
2021
Later among the works it cites.
Jacovi, A., A. Marasović, T. Miller, and Y. Goldberg, 2021: Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI. Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
2021
Later among the works it cites.
Lagerquist, R., D. Turner, I. Ebert-Uphoff, J. Stewart, and V. Hagerty, 2021: Using deep learning to emulate and accelerate a radiative transfer model. Journal of Atmospheric and Oceanic Technology
2021
Later among the works it cites.
Mamalakis, A., I. Ebert-Uphoff, and E. A. Barnes, 2021: Neural network attribution methods for problems in geoscience: A novel synthetic benchmark dataset. arXiv, 2103.10005
2021
Later among the works it cites.
Mecikalski, J. R., T. N. Sandmæl, E. M. Murillo, C. R. Homeyer, K. M. Bedka, J. M. Apke, and C. P. Jewett, 2021: A Random-Forest Model to Assess Predictor Importance and Nowcast Severe Storms Using High-Resolution Radar–GOES Satellite–Lightning Observations. Mon. Wea. Rev
2021
Later among the works it cites.
Miller, W. J. S., and Coauthors, 2021: Exploring the usefulness of downscaling free forecasts from the warn-on-forecast system. Wea. Forecasting
2021
Later among the works it cites.
Rudin, C., C. Chen, Z. Chen, H. Huang, L. Semenova, and C. Zhong, 2021: Interpretable Machine Learning: Fundamental Principles and 10 Grand Challenges. arXiv
2021
Later among the works it cites.
2022
Closest in time.
Clark, A. J., and E. D. Loken, 2022: Machine learning–derived severe weather probabilities from a warn-on-forecast system. Weather and Forecasting
2022
Closest in time.
Covert, I., and A. Algaba, 2022: sage. Github, URL https://github.com/iancovert/sage
2022
Closest in time.
Flora, M., and S. Handler, 2022: Scikit-Explain. Github, URL https://github.com/monte-flora/scikit-explain
2022
Closest in time.
Flora, M., C. Potvin, S. Handler, and A. McGovern, 2022: A Comparative Study of Explanation Methods for Traditional Machine Learning Models Part 2: Measuring and Improving Machine Learning Model Explainability. Artificial Intelligence for Earth Sciences
2022
Closest in time.
Hafner, D., 2022: bayesian-histograms. Github, URL https://github.com/dionhaefner/bayesian-histograms
2022
Closest in time.
Krishna, S., T. Han, A. Gu, J. Pombra, S. Jabbari, S. Wu, and H. Lakkaraju, 2022: The Disagreement Problem in Explainable Machine Learning: A Practitioner’s Perspective. arXiv
2022
Closest in time.
Loken, E. D., A. J. Clark, and A. McGovern, 2022: Comparing and interpreting differently-designed random forests for next-day severe weather hazard prediction. Wea. Forecasting
2022
Closest in time.
Shield, S. A., and A. L. Houston, 2022: Diagnosing Supercell Environments: A Machine Learning Approach. Wea. Forecasting
2022
Closest in time.
Crevier, L.-P., and Y. Delage, 2001: METRo: A New Model for Road-Condition Forecasting in Canada. J. Appl. Meteor
2026
Closest in time.
Hernández, J. D. R., Óscar José Mesa, and U. Lall, 2020: ENSO Dynamics, Trends, and Prediction Using Machine Learning. Wea. Forecasting
2081
Closest in time.