2018

Modes of Information Flow

James, Ryan G., Ayala, Blanca Daniella Mansante, Zakirov, Bahti et al.

Understand

Information flow between components of a system takes many forms and is key to understanding the organization and functioning of large-scale, complex systems.

We demonstrate three modalities of information flow from time series X to time series Y.
Intrinsic information flow exists when the past of X is individually predictive of the present of Y, independent of Y's past; this is most commonly considered information flow.
Shared information flow exists when X's past is predictive of Y's present in the same manner as Y's past; this occurs due to synchronization or common driving, for example.

Built on

The lattice theory of information
C. E. Shannon · 1953
Earlier work this paper cites.
An Introduction to Cybernetics
W. Ross Ashby · 1960
Earlier work this paper cites.
Information without probability
R. S. Ingarden and K. Urbanik · 1962
Earlier work this paper cites.
Information Theory and Statistics
S. Kullback · 1968
Earlier work this paper cites.
An Introduction to Probability Theory and its Applications
W. Feller · 1970
Earlier work this paper cites.
Strange attractors, chaotic behavior, and information flow
R. Shaw · 1981
Earlier work this paper cites.
Lyapunov analysis and information flow in coupled map lattices
K. Kaneko · 1986
Earlier work this paper cites.
Elements of Information Theory
T. M. Cover and J. A. Thomas · 1991
Earlier work this paper cites.
A new outlook on Shannon’s information measures
R. W. Yeung · 1991
Earlier work this paper cites.
Secret key agreement by public discussion from common information
U. M. Maurer · 1993
Earlier work this paper cites.
Unconditionally secure key agreement and the intrinsic conditional information
U. M. Maurer and S. Wolf · 1999
Earlier work this paper cites.
Measuring information transfer
T. Schreiber · 2000
Earlier work this paper cites.

Similar

Information Theory, Inference and Learning Algorithms
D. J. C. MacKay · 2003
Cited alongside, same era.
A property of the intrinsic mutual information
M. Christandl, R. Renner, and S. Wolf · 2003
Cited alongside, same era.
Information theory, inference and learning algorithms
D. J. C. MacKay · 2003
Cited alongside, same era.
Regularities unseen, randomness observed: Levels of entropy convergence
J. P. Crutchfield and D. P. Feldman · 2003
Cited alongside, same era.
Nonlinear time series analysis
H. Kantz and T. Schreiber · 2004
Cited alongside, same era.
Estimating mutual information
A. Kraskov, H. Stögbauer, and P. Grassberger · 2004
Cited alongside, same era.
Elements of Information Theory
T. M. Cover and J. A. Thomas · 2006
Cited alongside, same era.
Information theory and network coding
R. W. Yeung · 2008
Cited alongside, same era.
Anatomy of a bit: Information in a time series observation
R. G. James, C. J. Ellison, and J. P. Crutchfield · 2011
Cited alongside, same era.
Between order and chaos
J. P. Crutchfield · 2012
Cited alongside, same era.
Asymmetric information flow between market index and individual stocks in several stock markets
O. Kwon and G. Oh · 2012
Cited alongside, same era.
On achieving a positive rate in the source model key agreement problem
Original
A. Gohari, O. Günlü, and G. Kramer
Cited in the paper.

Then

The Liang-Kleeman information flow: Theory and applications
X. S. Liang · 2013
Later among the works it cites.
Shared information—new insights and problems in decomposing information in complex systems
N. Bertschinger, J. Rauh, E. Olbrich, and J. Jost · 2013
Later among the works it cites.
Second-law-like inequalities with information and their interpretations
J. M. Horowitz and H. Sandberg · 2014
Later among the works it cites.
Causation entropy identifies indirect influences, dominance of neighbors and anticipatory couplings
J. Sun and E. M. Bollt · 2014
Later among the works it cites.
Information flows? A critique of transfer entropies
R. G. James, N. Barnett, and J. P. Crutchfield · 2016
Later among the works it cites.
An Introduction to Transfer Entropy: Information Flow in Complex Systems
T. Bossomaier, L. Barnett, M. Harré, and J. T. Lizier · 2016
Later among the works it cites.
Information flows? A critique of transfer entropies
R. G. James, N. Barnett, and J. P. Crutchfield · 2016
Later among the works it cites.
Information-theoretic secret-key agreement: The asymptotically tight relation between the secret-key rate and the channel quality ratio
D. Jost, U. Maurer, and J. L. Ribeiro · 2017
Later among the works it cites.
Secret sharing and shared information
J. Rauh · 2017
Later among the works it cites.
Causal network discovery by iterative conditioning: comparison of algorithms
Original
J. Hlinka and J. Kořenek · 2018
Closest in time.
dit: a Python package for discrete information theory
R. G. James, C. J. Ellison, and J. P. Crutchfield · 2018
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…