Fetching the paper…
Reading the bibliography…
Notable progress has been made in numerous fields of machine learning based on neural network-driven mutual information (MI) bounds.
Asymptotic evaluation of certain markov process expectations for large time, i
Monroe D Donsker and SR Srinivasa Varadhan · 1975
Earlier work this paper cites.
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998
Earlier work this paper cites.
Information maximization in noisy channels : A variational approach
David Barber and Felix V. Agakov · 2003
Earlier work this paper cites.
Fundamentals of convex analysis
Jean-Baptiste Hiriart-Urruty and Claude Lemaréchal · 2004
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky · 2009
Earlier work this paper cites.
Estimating divergence functionals and the likelihood ratio by convex risk minimization
XuanLong Nguyen, Martin J. Wainwright, and Michael I. Jordan · 2010
Earlier work this paper cites.
Tighter variational representations of f-divergences via restriction to probability measures
Avraham Ruderman, Mark D. Reid, Dario García-García, and James Petterson · 2012
Earlier work this paper cites.
Generative adversarial nets
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron C. Courville, and Yoshua Bengio · 2014
Earlier work this paper cites.
Lecture notes on information theory
Yury Polyanskiy and Yihong Wu · 2014
Earlier work this paper cites.
Faster R-CNN: towards real-time object detection with region proposal networks
Shaoqing Ren, Kaiming He, Ross B. Girshick, and Jian Sun · 2015
Earlier work this paper cites.
Deep learning and the information bottleneck principle
Naftali Tishby and Noga Zaslavsky · 2015
Earlier work this paper cites.
Infogan: Interpretable representation learning by information maximizing generative adversarial nets
Xi Chen, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, and Pieter Abbeel · 2016
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Earlier work this paper cites.
f-gan: Training generative neural samplers using variational divergence minimization
Sebastian Nowozin, Botond Cseke, and Ryota Tomioka · 2016
Earlier work this paper cites.
Opening the black box of deep neural networks via information
Ravid Shwartz-Ziv and Naftali Tishby · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin · 2017
Cited alongside, same era.
Mutual information neural estimation
Mohamed Ishmael Belghazi, Aristide Baratin, Sai Rajeswar, Sherjil Ozair, Yoshua Bengio, R. Devon Hjelm, and Aaron C. Courville · 2018
Cited alongside, same era.
On the information bottleneck theory of deep learning
Andrew M. Saxe, Yamini Bansal, Joel Dapello, Madhu Advani, Artemy Kolchinsky, Brendan D. Tracey, and David D. Cox · 2018
Cited alongside, same era.
Representation learning with contrastive predictive coding
Aäron van den Oord, Yazhe Li, and Oriol Vinyals · 2018
Cited alongside, same era.
Reducing noise in GAN training with variance reduced extragradient
Tatjana Chavdarova, Gauthier Gidel, François Fleuret, and Simon Lacoste-Julien · 2019
Cited alongside, same era.
Data-efficient image recognition with contrastive predictive coding
Olivier J. Hénaff · 2020
Closest in time.
Supervised contrastive learning
Prannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna, Yonglong Tian, Phillip Isola, Aaron Maschinot, Ce Liu, and Dilip Krishnan · 2020
Closest in time.
Formal limitations on the measurement of mutual information
David McAllester and Karl Stratos · 2020
Closest in time.
Elastic-infogan: Unsupervised disentangled representation learning in class-imbalanced data
Utkarsh Ojha, Krishna Kumar Singh, Cho-Jui Hsieh, and Yong Jae Lee · 2020
Closest in time.
Vargrad: A low-variance gradient estimator for variational inference
Lorenz Richter, Ayman Boustati, Nikolas Nüsken, Francisco J. R. Ruiz, and Ömer Deniz Akyildiz · 2020
Closest in time.
Understanding the limitations of variational mutual information estimators
Jiaming Song and Stefano Ermon · 2020
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
R. Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Philip Bachman, Adam Trischler, and Yoshua Bengio · 2019
Cited alongside, same era.
Data-efficient mutual information neural estimator
Xiao Lin, Indranil Sur, Samuel A. Nastase, Ajay Divakaran, Uri Hasson, and Mohamed R. Amer · 2019
Cited alongside, same era.
On variational bounds of mutual information
Ben Poole, Sherjil Ozair, Aäron van den Oord, Alexander A. Alemi, and George Tucker · 2019
Cited alongside, same era.
Promp: Proximal meta-policy search
Jonas Rothfuss, Dennis Lee, Ignasi Clavera, Tamim Asfour, and Pieter Abbeel · 2019
Cited alongside, same era.
Loss functions modulate the optimal bias-variance trade-off
Adam Bear and Fiery Cushman · 2020
Cited alongside, same era.
A unifying mutual information view of metric learning: Cross-entropy vs. pairwise losses
Malik Boudiaf, Jérôme Rony, Imtiaz Masud Ziko, Eric Granger, Marco Pedersoli, Pablo Piantanida, and Ismail Ben Ayed · 2020
Cited alongside, same era.
A simple framework for contrastive learning of visual representations
Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey E. Hinton · 2020
Cited alongside, same era.
Closest in time.
On mutual information maximization for representation learning
Michael Tschannen, Josip Djolonga, Paul K. Rubenstein, Sylvain Gelly, and Mario Lucic · 2020
Closest in time.
Mutual information gradient estimation for representation learning
Liangjian Wen, Yiji Zhou, Lirong He, Mingyuan Zhou, and Zenglin Xu · 2020
Closest in time.
On mutual information in contrastive learning for visual representations
Mike Wu, Chengxu Zhuang, Milan Mosse, Daniel Yamins, and Noah D. Goodman · 2020
Closest in time.
Visual navigation with asynchronous proximal policy optimization in artificial agents
Fanyu Zeng, Chen Wang, and Weitian Wang · 2020
Closest in time.
Vicreg: Variance-invariance-covariance regularization for self-supervised learning
Adrien Bardes, Jean Ponce, and Yann LeCun · 2021
Closest in time.
Emerging properties in self-supervised vision transformers
Mathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou, Julien Mairal, Piotr Bojanowski, and Armand Joulin · 2021
Closest in time.
A novel estimator of mutual information for learning to disentangle textual representations
Pierre Colombo, Pablo Piantanida, and Chloé Clavel · 2021
Closest in time.
Ib-gan: Disengangled representation learning with information bottleneck generative adversarial networks
Insu Jeon, Wonkwang Lee, Myeongjang Pyeon, and Gunhee Kim · 2021
Closest in time.
Support of a random variable
Marco Taboga · 2021
Closest in time.