A Characterization of Entropy in Terms of Information Loss

C. E. Shannon, A mathematical theory of communication , Bell System Tech. J. 27 (1948), 379–423

1948

Earlier work this paper cites.

D. K. Faddeev, On the concept of entropy of a finite probabilistic scheme , Uspehi Mat. Nauk (N.S.) 11 (1956), no. 1(67), 227–231. (In Russian.) German translation: Zum Begriff der Entropie eines endlichen Wahrscheinlichkeitsschemas, Arbeiten zur Informationstheorie I , Berlin, Deutscher Verlag der Wissenschaften, 1957, pp. 85–90

1957

Earlier work this paper cites.

A. Rényi, Measures of information and entropy , in J. Neymann (ed.), 4th Berkeley Symposium on Mathematical Statistics and Probability , University of California Press, 1961, pp. 547–561

1961

Earlier work this paper cites.

J. Havrda and F. Charvát, Quantification method of classification processes: concept of structural α \alpha -entropy, Kybernetika 3 (1967), 30–35

1967

Earlier work this paper cites.

S. Mac Lane, Categories for the Working Mathematician , Graduate Texts in Mathematics 5, Springer, 1971

1971

Cited alongside, same era.

J. Aczél and Z. Daróczy, On Measures of Information and their Characterizations , Mathematics in Science and Engineering, vol. 115, Academic Press, New York, 1975

1975

Cited alongside, same era.

G. P. Patil and C. Taillie, Diversity as a concept and its measurement, Journal of the American Statistical Association 77 (1982), 548–561

1982

Cited alongside, same era.

C. Tsallis, Possible generalization of Boltzmann–Gibbs statistics, Journal of Statistical Physics 52 (1988), 479–487

1988

Later among the works it cites.

S. Furuichi, On uniqueness theorems for Tsallis entropy and Tsallis relative entropy , IEEE Transactions on Information Theory 51 (2005), 3638–3645

2005

Later among the works it cites.

T. M. Cover and J. A. Thomas, Elements of Information Theory , Wiley Series in Telecommunications and Signal Processing, Wiley-Interscience 2006

2006

Later among the works it cites.