Fetching the paper…
Reading the bibliography…
The information bottleneck (IB) problem tackles the issue of obtaining relevant compressed representations $T$ of some random variable $X$ for the task of predicting $Y$.
Relevant sparse codes with variational information bottleneck
Chalk Matthew, Marre Olivier, Tkacik Gasper · 1965
Earlier work this paper cites.
Emergence of invariance and disentanglement in deep representations
Achille Alessandro, Soatto Stefano · 1980
Earlier work this paper cites.
Properties of cross-entropy minimization
Shore John, Johnson Rodney · 1981
Earlier work this paper cites.
Minimum cross-entropy pattern classification and cluster analysis
Shore John E, Gray Robert M · 1982
Earlier work this paper cites.
A density-based algorithm for discovering clusters in large spatial databases with noise
Ester Martin, Kriegel Hans-Peter, Sander Jörg, Xu Xiaowei, others · 1996
Earlier work this paper cites.
Sparse spatial autoregressions
Pace R Kelley, Barry Ronald · 1997
Earlier work this paper cites.
Gradient-based learning applied to document recognition
LeCun Yann, Bottou Léon, Bengio Yoshua, Haffner Patrick, others · 1998
Earlier work this paper cites.
Text classification and segmentation using minimum cross-entropy
Teahan William John · 2000
Earlier work this paper cites.
The information bottleneck method
Tishby Naftali, Pereira Fernando C, Bialek William · 2000
Earlier work this paper cites.
Building a question answering test collection
Voorhees Ellen M, Tice Dawn M · 2000
Earlier work this paper cites.
Data clustering by markovian relaxation and the information bottleneck method
Tishby Naftali, Slonim Noam · 2001
Earlier work this paper cites.
Learning question classifiers
Li Xin, Roth Dan · 2002
Earlier work this paper cites.
Unsupervised document classification using sequential information maximization
Slonim Noam, Friedman Nir, Tishby Naftali · 2002
Earlier work this paper cites.
Pricing Communication Networks Economics, Technology and Modelling. 2003
Courcoubetis Costas · 2003
Earlier work this paper cites.
An information theoretic tradeoff between complexity and accuracy
Gilad-Bachrach Ran, Navot Amir, Tishby Naftali · 2003
Earlier work this paper cites.
Information-based clustering
Slonim Noam, Atwal Gurinder Singh, Tkačik Gašper, Bialek William · 2005
Earlier work this paper cites.
Pattern recognition and machine learning. 2006
Bishop Christopher M · 2006
Cited alongside, same era.
Understanding the difficulty of training deep feedforward neural networks
Glorot Xavier, Bengio Yoshua · 2010
Cited alongside, same era.
Learning and generalization with the information bottleneck
Shamir Ohad, Sabato Sivan, Tishby Naftali · 2010
Cited alongside, same era.
Scikit-learn: Machine learning in Python
Pedregosa Fabian, Varoquaux Gaël, Gramfort Alexandre, Michel Vincent, Thirion Bertrand, Grisel Olivier, Blondel Mathieu, Prettenhofer Peter, Weiss Ron, Dubourg Vincent, others · 2011
Cited alongside, same era.
Elements of information theory. 2012
Cover Thomas M, Thomas Joy A · 2012
Cited alongside, same era.
Imagenet classification with deep convolutional neural networks
Krizhevsky Alex, Sutskever Ilya, Hinton Geoffrey E · 2012
Cited alongside, same era.
Information-theoretic analysis of generalization capability of learning algorithms
Xu Aolin, Raginsky Maxim · 2017
Later among the works it cites.
Uncertainty in the variational information bottleneck
Alemi Alexander A, Fischer Ian, Dillon Joshua V · 2018
Later among the works it cites.
Toward a unified theory of efficient, predictive, and sparse coding
Chalk Matthew, Marre Olivier, Tkačik Gašper · 2018
Later among the works it cites.
On the equivalence of double maxima and KL-means for information bottleneck-based source coding
Hassanpour Shayan, Wübben Dirk, Dekorsy Armin · 2018
Later among the works it cites.
Variational Discriminator Bottleneck: Improving Imitation Learning, Inverse RL, and GANs by Constraining Information Flow
Peng Xue Bin, Kanazawa Angjoo, Toyer Sam, Abbeel Pieter, Levine Sergey · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Adam: A method for stochastic optimization
Kingma Diederik P, Ba Jimmy · 2014
Cited alongside, same era.
Glove: Global vectors for word representation
Pennington Jeffrey, Socher Richard, Manning Christopher · 2014
Cited alongside, same era.
Deep variational information bottleneck
Alemi Alexander A, Fischer Ian, Dillon Joshua V, Murphy Kevin · 2016
Cited alongside, same era.
Estimating mixture entropy with pairwise distances
Kolchinsky Artemy, Tracey Brendan · 2017
Cited alongside, same era.
Information-distilling quantizers
Nazer Bobak, Ordentlich Or, Polyanskiy Yury · 2017
Cited alongside, same era.
Automatic differentiation in pytorch
Paszke Adam, Gross Sam, Chintala Soumith, Chanan Gregory, Yang Edward, DeVito Zachary, Lin Zeming, Desmaison Alban, Antiga Luca, Lerer Adam · 2017
Cited alongside, same era.
The role of the information bottleneck in representation learning
Vera Matias, Piantanida Pablo, Vega Leonardo Rey · 2018
Later among the works it cites.
Efficient compression in color naming and its evolution
Zaslavsky Noga, Kemp Charles, Regier Terry, Tishby Naftali · 2018
Later among the works it cites.
Learning representations for neural network-based classification using the information bottleneck principle
Amjad Rana Ali, Geiger Bernhard Claus · 2019
Closest in time.
Infobot: Transfer and exploration via the information bottleneck
Goyal Anirudh, Islam Riashat, Strouse Daniel, Ahmed Zafarali, Botvinick Matthew, Larochelle Hugo, Levine Sergey, Bengio Yoshua · 2019
Closest in time.
Specializing Word Embeddings (for Parsing) by Information Bottleneck
Li Xiang Lisa, Eisner Jason · 2019
Closest in time.
Learnability for the Information Bottleneck
Wu Tailin, Fischer Ian, Chuang Isaac, Tegmark Max · 2019
Closest in time.
Learning Representations in Reinforcement Learning:An Information Bottleneck Approach. 2019
Yingjun Pei, Xinwen Hou · 2019
Closest in time.
Restricting the Flow: Information Bottlenecks for Attribution
Schulz Karl, Sixt Leon, Tombari Federico, Landgraf Tim · 2020
Closest in time.
Dynamics-Aware Unsupervised Skill Discovery
Sharma Archit, Gu Shixiang, Levine Sergey, Kumar Vikash, Hausman Karol · 2020
Closest in time.
Phase Transitions for the Information Bottleneck in Representation Learning
Wu Tailin, Fischer Ian · 2020
Closest in time.