Fetching the paper…
Reading the bibliography…
The problem of estimating the Kullback-Leibler divergence $D(P\|Q)$ between two unknown distributions $P$ and $Q$ is studied, under the assumption that the alphabet size $k$ of the distributions can scale to infinity.
Theory of Approximation of Functions of a Real Variable
A. F. Timan, · 1963
Earlier work this paper cites.
Constructive approximation
R. A DeVore and G. G Lorentz, · 1993
Earlier work this paper cites.
“Two-sample test statistics for measuring discrepancies between two multivariate probability density functions using kernel-based density estimates,”
N. H. Anderson, P. Hall, and D. M. Titterington, · 1994
Earlier work this paper cites.
“Convergence properties of functional estimates for discrete distributions,”
A. Antos and I. Kontoyiannis, · 2001
Earlier work this paper cites.
“Universal estimation of entropy and divergence via block sorting,”
H. Cai, S. R. Kulkarni, and S. Verdú, · 2002
Earlier work this paper cites.
“A Kullback-Leibler divergence based kernel for SVM classification in multimedia applications,”
P. J. Moreno, P. P. Ho, and N. Vasconcelos, · 2003
Earlier work this paper cites.
“A divisive information-theoretic feature clustering algorithm for text classification,”
I. S. Dhillon, S. Mallela, and R. Kumar, · 2003
Earlier work this paper cites.
“Estimation of entropy and mutual information,”
L. Paninski, · 2003
Earlier work this paper cites.
“Divergence estimation of continuous distributions based on data-dependent partitions,”
Q. Wang, S. R Kulkarni, and S. Verdú, · 2005
Earlier work this paper cites.
Probability and Computing: Randomized Algorithms and Probabilistic Analysis
M. Mitzenmacher and E. Upfal, · 2005
Earlier work this paper cites.
“Universal divergence estimation for finite-alphabet sources,”
H. Cai, S. R. Kulkarni, and S. Verdú, · 2006
Earlier work this paper cites.
Introduction to Nonparametric Estimation
A. B. Tsybakov, · 2008
Cited alongside, same era.
“Divergence estimation for multidimensional densities via k k -nearest-neighbor distances,”
Q. Wang, S. R Kulkarni, and S. Verdú, · 2009
Cited alongside, same era.
“Estimating divergence functionals and the likelihood ratio by convex risk minimization,”
X. Nguyen, M. J Wainwright, and M. Jordan, · 2010
Cited alongside, same era.
“Estimating the unseen: an n/log (n)-sample estimator for entropy and support size, shown optimal via new CLTs,”
G. Valiant and P. Valiant, · 2011
Cited alongside, same era.
Rational Approximation of Real Functions
P. P. Petrushev and V. A. Popov, · 2011
Cited alongside, same era.
“Ensemble estimation of multivariate f-divergence,”
K. R. Moon and A. O. Hero, · 2014
“Minimax estimation of functionals of discrete distributions,”
J. Jiao, K. Venkat, Y. Han, and T. Weissman, · 2015
Later among the works it cites.
“Competitive distribution estimation: Why is Good-Turing good,”
A. Orlitsky and A. T. Suresh, · 2015
Later among the works it cites.
“Estimation of KL divergence between large-alphabet distributions,”
Y. Bu, S. Zou, Y. Liang, and V. V Veeravalli, · 2016
Closest in time.
“Universal outlying sequence detection for continuous observations,”
Y. Bu, S. Zou, Y. Liang, and V. V. Veeravalli, · 2016
Closest in time.
“Minimax rates of entropy estimation on large alphabets via best polynomial approximation,”
Y. Wu and P. Yang, · 2016
Closest in time.
“Minimax estimation of KL divergence between discrete distributions,”
Y. Han, J. Jiao, and T. Weissman, · 2016
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
“Nonparametric estimation of Küllback-Leibler divergence,”
Z. Zhang and M. Grabchak, · 2014
Cited alongside, same era.
“Rényi divergence and Kullback-Leibler divergence,”
T. Van Erven and P. Harremos, · 2014
Cited alongside, same era.
Polynomial Approximation on Polytopes
V. Totik, · 2014
Cited alongside, same era.
T. T. Cai and M. G. Low, · 2014
Cited alongside, same era.
Closest in time.
“Minimax estimation of the ℓ 1 \ell_{1} distance,”
J. Jiao, Y. Han, and T. Weissman, · 2016
Closest in time.
“Inhomogeneous hypergraph clustering with applications,”
P. Li and O. Milenkovic, · 2017
Closest in time.
“Maximum likelihood estimation of functionals of discrete distributions,”
J. Jiao, K. Venkat, Y. Han, and T. Weissman, · 2017
Closest in time.
“The nearest neighbor information estimator is adaptively near minimax rate-optimal,”
J. Jiao, W. Gao, and Y. Han, · 2017
Closest in time.