Influence Functions for Machine Learning: Nonparametric Estimators for Entropies, Divergences and Mutual Informations

Von Mises calculus for statistical functionals

Luisa Fernholz · 1983

Earlier work this paper cites.

Estimating integrated squared density derivatives: sharp best order of convergence estimates

Peter J. Bickel and Ya’acov Ritov · 1988

Earlier work this paper cites.

Estimation of integral functionals of a density

Lucien Birgé and Pascal Massart · 1995

Earlier work this paper cites.

Estimating nonquadratic functionals of a density using haar wavelets

Gérard Kerkyacharian and Dominique Picard · 1996

Earlier work this paper cites.

Efficient estimation of integral functionals of a density

Béatrice Laurent · 1996

Earlier work this paper cites.

Nonparametric entropy estimation: An overview

Jan Beirlant, Edward J. Dudewicz, László Györfi, and Edward C. Van der Meulen · 1997

Earlier work this paper cites.

Lectures on Prob. Theory and Stat

M Emery, A Nemirovski, and D Voiculescu · 1998

Earlier work this paper cites.

Asymptotic Statistics

Aad W. van der Vaart · 1998

Earlier work this paper cites.

Applications of entropic spanning graphs

Hero, Bing Ma, O. J. J. Michel, and J. Gorman · 2002

Earlier work this paper cites.

An Information Theoretic Approach to the Functional Classification of Neurons

Elad Schneidman, William Bialek, and Michael J. Berry II · 2002

Earlier work this paper cites.

A Divisive Information Theoretic Feature Clustering Algorithm for Text Classification

Inderjit S. Dhillon, Subramanyam Mallela, and Rahul Kumar · 2003

Earlier work this paper cites.

ICA using spacings estimates of entropy

Erik Learned-Miller and Fisher John · 2003

Earlier work this paper cites.

A new class of Entropy Estimators for Multi-dimensional Densities

Erik G Miller · 2003

Cited alongside, same era.

A new class of random vector entropy estimators and its applications

Mohammed Nawaz Goria, Nikolai N Leonenko, Victor V Mergel, and Pier Luigi Novi Inverardi · 2005

Cited alongside, same era.

Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy

Hanchuan Peng, Fulmi Long, and Chris Ding · 2005

Cited alongside, same era.

Real-time adaptive information-theoretic optimization of neurophysiology experiments

Jeremy Lewi, Robert Butera, and Liam Paninski · 2006

Cited alongside, same era.

KL divergence estimation of continuous distributions

Fernando Pérez-Cruz · 2008

Cited alongside, same era.

Introduction to Nonparametric Estimation

Alexandre B. Tsybakov · 2008

Estimating divergence functionals and the likelihood ratio by convex risk minimization

XuanLong Nguyen, Martin J. Wainwright, and Michael I. Jordan · 2010

Later among the works it cites.

Estimation of Rényi Entropy and Mutual Information Based on Generalized Nearest-Neighbor Graphs

Dávid Pál, Barnabás Póczos, and Csaba Szepesvári · 2010

Later among the works it cites.

On the estimation of alpha-divergences

Barnabás Póczos and Jeff Schneider · 2011

Later among the works it cites.

Nonparametric Divergence Estimation with Applications to Machine Learning on Distributions

Barnabás Póczos, Liang Xiong, and Jeff G. Schneider · 2011

Later among the works it cites.

Estimation of entropy-type integral functionals

David Källberg and Oleg Seleznjev · 2012

Later among the works it cites.

Exponential concentration for mutual information estimation with application to forests