Multivariate Information Bottleneck

Understand

The Information bottleneck method is an unsupervised non-parametric data organization technique.

• Given a joint distribution P(A,B), this method constructs a new variable T that extracts partitions, or clusters, over the values of A that are informative about B.
• The information bottleneck has already been applied to document classification, gene expression, neural code, and spectral analysis.
• In this paper, we introduce a general principled framework for multivariate extensions of the information bottleneck method.