Fetching the paper…
Reading the bibliography…
We consider a natural measure of relevance: the reduction in optimal prediction risk in the presence of side information.
C. E. Shannon, “A mathematical theory of communication,” The Bell System Technical Journal , vol. 27, pp. 379–423, 623–656, 1948
1948
Earlier work this paper cites.
I. J. Good, “Rational decisions,” Journal of the Royal Statistical Society. Series B (Methodological) , pp. 107–114, 1952
1952
Earlier work this paper cites.
M. H. DeGroot, “Uncertainty, information, and sequential experiments,” Ann. Math. Statist. , vol. 33, no. 2, pp. 404–419, 06 1962. [Online]. Available: http://dx.doi.org/10.1214/aoms/1177704567
1962
Earlier work this paper cites.
C. Chow and C. Liu, “Approximating discrete probability distributions with dependence trees,” Information Theory, IEEE Transactions on , vol. 14, no. 3, pp. 462–467, 1968
1968
Earlier work this paper cites.
C. W. Granger, “Investigating causal relations by econometric models and cross-spectral methods,” Econometrica: Journal of the Econometric Society , pp. 424–438, 1969
1969
Earlier work this paper cites.
C. A. Sims, “Money, income, and causality,” The American Economic Review , vol. 62, no. 4, pp. 540–552, 1972
1972
Earlier work this paper cites.
M. O. Hill, “Diversity and evenness: a unifying notation and its consequences,” Ecology , vol. 54, no. 2, pp. 427–432, 1973
1973
Earlier work this paper cites.
H. Marko, “The bidirectional communication theory–a generalization of information theory,” IEEE Trans. Commum. , vol. COM-21, pp. 1345–1351, 1973
1973
Earlier work this paper cites.
P. Kannappan and C. Ng, “Measurable solutions of functional equations related to information theory,” Proceedings of the American Mathematical Society , pp. 303–310, 1973
1973
Earlier work this paper cites.
J. Aczél, B. Forte, and C. Ng, “Why the Shannon and Hartley entropies are’natural’,” Advances in Applied Probability , pp. 131–146, 1974
1974
Earlier work this paper cites.
Y. Hosoya, “On the granger condition for non-causality,” Econometrica , vol. 45, no. 7, pp. 1735–36, 1977
1977
Earlier work this paper cites.
——, “Testing for causality: a personal viewpoint,” Journal of Economic Dynamics and control , vol. 2, pp. 329–352, 1980
1980
Earlier work this paper cites.
G. Chamberlain, “The general equivalence of granger and sims causality,” Econometrica: Journal of the Econometric Society , pp. 569–581, 1982
1982
Earlier work this paper cites.
J. Geweke, “Measurement of linear dependence and feedback between multiple time series,” Journal of the American Statistical Association , vol. 77, no. 378, pp. 304–313, 1982
1982
Earlier work this paper cites.
G. Maksa, “Solution on the open triangle of the generalized fundamental equation of information with four unknown functions,” Utilitas Math , vol. 21, pp. 267–282, 1982
1982
Earlier work this paper cites.
J. F. Geweke, “Measures of conditional linear dependence and feedback between time series,” Journal of the American Statistical Association , vol. 79, no. 388, pp. 907–915, 1984
1984
Earlier work this paper cites.
C. Gourieroux, A. Monfort, and E. Renault, “Kullback causality measures,” Annales d’Economie et de Statistique , pp. 369–410, 1987
1987
Earlier work this paper cites.
R. Linsker, “Self-organization in a perceptual network,” Computer , vol. 21, no. 3, pp. 105–117, 1988
1988
Cited alongside, same era.
J. L. Massey, “Causality, feedback, and directed information,” in Proc. Int. Symp. Inf. Theory Appl. , Honolulu, HI, Nov. 1990, pp. 303–305
1990
Cited alongside, same era.
J. R. Quinlan, C4. 5: programs for machine learning . Morgan kaufmann, 1993, vol. 1
1993
Cited alongside, same era.
P. Viola and W. M. Wells III, “Alignment by maximization of mutual information,” International journal of computer vision , vol. 24, no. 2, pp. 137–154, 1997
1997
Cited alongside, same era.
A. P. Dawid, “Coherent measures of discrepancy, uncertainty and dependence, with applications to bayesian predictive experimental design,” Technical Report 139, Department of Statistical Science, University College London. http://www. ucl. ac. uk/Stats/research/abs94. html, Tech. Rep., 1998
L. Barnett, A. B. Barrett, and A. K. Seth, “Granger causality and transfer entropy are equivalent for Gaussian variables,” Physical review letters , vol. 103, no. 23, p. 238701, 2009
2009
Later among the works it cites.
L. Batina, B. Gierlichs, E. Prouff, M. Rivain, F.-X. Standaert, and N. Veyrat-Charvillon, “Mutual information analysis: a comprehensive study,” Journal of Cryptology , vol. 24, no. 2, pp. 269–291, 2011
2011
Later among the works it cites.
G. Valiant and P. Valiant, “Estimating the unseen: an n / log n n/\log n -sample estimator for entropy and support size, shown optimal via new CLTs,” in Proceedings of the 43rd annual ACM symposium on Theory of computing . ACM, 2011, pp. 685–694
2011
Later among the works it cites.
——, “The power of linear estimators,” in Foundations of Computer Science (FOCS), 2011 IEEE 52nd Annual Symposium on . IEEE, 2011, pp. 403–412
2011
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
1998
Cited alongside, same era.
E. L. Lehmann and G. Casella, Theory of point estimation . Springer, 1998, vol. 31
1998
Cited alongside, same era.
E. Erkip and T. M. Cover, “The efficiency of investment information,” Information Theory, IEEE Transactions on , vol. 44, no. 3, pp. 1026–1040, 1998
1998
Cited alongside, same era.
G. Kramer, Directed Information for Channels with Feedback . Konstanz: Hartung-Gorre Verlag, 1998, Dr. sc. thchn. Dissertation, Swiss Federal Institute of Technology (ETH) Zurich
1998
Cited alongside, same era.
T. Schreiber, “Measuring information transfer,” Physical review letters , vol. 85, no. 2, p. 461, 2000
2000
Cited alongside, same era.
J. P. Pluim, J. A. Maintz, and M. A. Viergever, “Mutual-information-based registration of medical images: a survey,” Medical Imaging, IEEE Transactions on , vol. 22, no. 8, pp. 986–1004, 2003
2003
Cited alongside, same era.
J. L. Massey and P. C. Massey, “Conservation of mutual and directed information,” in Proc. IEEE Int. Symp. Inf. Theory , 2005, pp. 157–158
2005
Cited alongside, same era.
N. Cesa-Bianchi and G. Lugosi, Prediction, learning, and games . Cambridge University Press, 2006
2006
Cited alongside, same era.
H. H. Permuter, Y.-H. Kim, and T. Weissman, “Interpretations of directed information in portfolio theory, data compression, and hypothesis testing,” Information Theory, IEEE Transactions on , vol. 57, no. 6, pp. 3248–3259, 2011
2011
Later among the works it cites.
S. Nowozin, “Improved information gain estimates for decision tree induction,” in Proceedings of the 29th International Conference on Machine Learning (ICML-12) , 2012, pp. 297–304
2012
Later among the works it cites.
P.-O. Amblard and O. J. J. Michel, “The relation between granger causality and directed information theory: a review,” Entropy , vol. 15, no. 1, pp. 113–143, 2012
2012
Later among the works it cites.
P. Valiant and G. Valiant, “Estimating the unseen: improved estimators for entropy and other properties,” in Advances in Neural Information Processing Systems , 2013, pp. 2157–2165
2013
Later among the works it cites.
J. Jiao, H. Permuter, L. Zhao, Y.-H. Kim, and T. Weissman, “Universal estimation of directed information,” Information Theory, IEEE Transactions on , vol. 59, no. 10, pp. 6220–6242, 2013
2013
Later among the works it cites.
S. Boucheron, G. Lugosi, and P. Massart, Concentration inequalities: A nonasymptotic theory of independence . Oxford University Press, 2013
2013
Later among the works it cites.
T. Courtade and T. Weissman, “Multiterminal source coding under logarithmic loss,” Information Theory, IEEE Transactions on , vol. 60, no. 1, pp. 740–761, 2014
2014
Closest in time.
2014
Closest in time.
J. Acharya, A. Orlitsky, A. T. Suresh, and H. Tyagi, “The complexity of estimating Rényi entropy,” available on arXiv , 2014
2014
Closest in time.
2014
Closest in time.
J. Jiao, T. Courtade, A. No, K. Venkat, and T. Weissman, “Information measures: the curious case of the binary alphabet,” IEEE Transactions on Information Theory , vol. 60, no. 12, pp. 7616–7626, 2014
2014
Closest in time.
J. Aczél and C. Ng, “Determination of all semisymmetric recursive information measures of multiplicative type on n positive discrete probability distributions,” Linear algebra and its applications , vol. 52, pp. 1–30, 1983
2014
Closest in time.
J. Jiao, K. Venkat, Y. Han, and T. Weissman, “Minimax estimation of functionals of discrete distributions,” IEEE Transactions on Information Theory , vol. 61, no. 5, pp. 2835–2885, 2015
2015
Closest in time.