Fetching the paper…
Reading the bibliography…
In this work, we perform unsupervised learning of representations by maximizing mutual information between an input and the output of a deep neural network encoder.
Asymptotic evaluation of certain markov process expectations for large time, iv
M.D Donsker and S.R.S Varadhan · 1983
Earlier work this paper cites.
Self-organization in a perceptual network
Ralph Linsker · 1988
Earlier work this paper cites.
An information-theoretic unsupervised learning algorithm for neural networks
Suzanna Becker · 1992
Earlier work this paper cites.
Learning factorial codes by predictability minimization
Jürgen Schmidhuber · 1992
Earlier work this paper cites.
An information-maximization approach to blind separation and blind deconvolution
Anthony J Bell and Terrence J Sejnowski · 1995
Earlier work this paper cites.
Mutual information maximization: models of cortical self-organization
Suzanna Becker · 1996
Earlier work this paper cites.
The self-organizing map
Teuvo Kohonen · 1998
Earlier work this paper cites.
Nonlinear independent component analysis: Existence and uniqueness results
Aapo Hyvärinen and Petteri Pajunen · 1999
Earlier work this paper cites.
Independent component analysis: algorithms and applications
Aapo Hyvärinen and Erkki Oja · 2000
Earlier work this paper cites.
Training products of experts by minimizing contrastive divergence
Geoffrey E Hinton · 2002
Earlier work this paper cites.
Slow feature analysis: Unsupervised learning of invariances
Laurenz Wiskott and Terrence J Sejnowski · 2002
Earlier work this paper cites.
Linear and nonlinear ica based on mutual information
Luís B Almeida · 2003
Earlier work this paper cites.
Multiscale structural similarity for image quality assessment
Zhou Wang, Eero P Simoncelli, and Alan C Bovik · 2003
Earlier work this paper cites.
Extracting and composing robust features with denoising autoencoders
Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol · 2008
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky and Geoffrey Hinton · 2009
Earlier work this paper cites.
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Michael Gutmann and Aapo Hyvärinen · 2010
Earlier work this paper cites.
Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion
Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol · 2010
Earlier work this paper cites.
An analysis of single-layer networks in unsupervised feature learning
Adam Coates, Andrew Ng, and Honglak Lee · 2011
Earlier work this paper cites.
Contractive auto-encoders: Explicit invariance during feature extraction
Salah Rifai, Pascal Vincent, Xavier Muller, Xavier Glorot, and Yoshua Bengio · 2011
Earlier work this paper cites.
A kernel two-sample test
Arthur Gretton, Karsten M Borgwardt, Malte J Rasch, Bernhard Schölkopf, and Alexander Smola · 2012
Earlier work this paper cites.
Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics
Michael U Gutmann and Aapo Hyvärinen · 2012
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012
Earlier work this paper cites.
Disentangling factors of variation for facial expression recognition
Salah Rifai, Yoshua Bengio, Aaron Courville, Pascal Vincent, and Mehdi Mirza · 2012
Earlier work this paper cites.
Representation learning: A review and new perspectives
Yoshua Bengio, Aaron Courville, and Pascal Vincent · 2013
Cited alongside, same era.
Auto-encoding variational bayes
Diederik Kingma and Max Welling · 2013
Cited alongside, same era.
Distributed representations of words and phrases and their compositionality
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean · 2013
Cited alongside, same era.
Learning word embeddings efficiently with noise-contrastive estimation
Andriy Mnih and Koray Kavukcuoglu · 2013
Cited alongside, same era.
Nice: non-linear independent components estimation
Laurent Dinh, David Krueger, and Yoshua Bengio · 2014
Cited alongside, same era.
Pixel recurrent neural networks
Aaron van den Oord, Nal Kalchbrenner, and Koray Kavukcuoglu · 2016
Later among the works it cites.
Context encoders: Feature learning by inpainting
Deepak Pathak, Philipp Krähenbühl, Jeff Donahue, Trevor Darrell, and Alexei A. Efros · 2016
Later among the works it cites.
One-shot generalization in deep generative models
Danilo Jimenez Rezende, Shakir Mohamed, Ivo Danihelka, Karol Gregor, and Daan Wierstra · 2016
Later among the works it cites.
Regularization with stochastic transformations and perturbations for deep semi-supervised learning
Mehdi Sajjadi, Mehran Javanmardi, and Tolga Tasdizen · 2016
Later among the works it cites.
Improved techniques for training gans
Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen · 2016
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Diederik P Kingma, Shakir Mohamed, Danilo Jimenez Rezende, and Max Welling · 2014
Cited alongside, same era.
Unsupervised visual representation learning by context prediction
Carl Doersch, Abhinav Gupta, and Alexei A Efros · 2015
Cited alongside, same era.
Batch normalization: Accelerating deep network training by reducing internal covariate shift
Sergey Ioffe and Christian Szegedy · 2015
Cited alongside, same era.
Deep learning face attributes in the wild
Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang · 2015
Cited alongside, same era.
Alireza Makhzani, Jonathon Shlens, Navdeep Jaitly, Ian Goodfellow, and Brendan Frey · 2015
Cited alongside, same era.
Unsupervised representation learning with deep convolutional generative adversarial networks
Alec Radford, Luke Metz, and Soumith Chintala · 2015
Cited alongside, same era.
From facial parts responses to face detection: A deep learning approach
Shuo Yang, Ping Luo, Chen-Change Loy, and Xiaoou Tang · 2015
Cited alongside, same era.
Unsupervised deep embedding for clustering analysis
Junyuan Xie, Ross Girshick, and Ali Farhadi · 2016
Later among the works it cites.
Towards principled methods for training generative adversarial networks
Martin Arjovsky and Léon Bottou · 2017
Later among the works it cites.
Unsupervised learning by predicting noise
Piotr Bojanowski and Armand Joulin · 2017
Later among the works it cites.
Learning independent features with adversarial nets for non-linear ica
Philemon Brakel and Yoshua Bengio · 2017
Later among the works it cites.
Deep adaptive image clustering
Jianlong Chang, Lingfeng Wang, Gaofeng Meng, Shiming Xiang, and Chunhong Pan · 2017
Later among the works it cites.
Multi-task self-supervised visual learning
Carl Doersch and Andrew Zisserman · 2017
Later among the works it cites.
Improved training of wasserstein gans
Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron Courville · 2017
Later among the works it cites.
Learning discrete representations via information maximizing self-augmented training
Weihua Hu, Takeru Miyato, Seiya Tokui, Eiichi Matsumoto, and Masashi Sugiyama · 2017
Later among the works it cites.
Independently controllable features
Valentin Thomas, Jules Pondard, Emmanuel Bengio, Marc Sarfati, Philippe Beaudoin, Marie-Jean Meurs, Joelle Pineau, Doina Precup, and Yoshua Bengio · 2017
Later among the works it cites.
Mine: mutual information neural estimation
Ishmael Belghazi, Aristide Baratin, Sai Rajeswar, Sherjil Ozair, Yoshua Bengio, Aaron Courville, and R Devon Hjelm · 2018
Closest in time.
Isolating sources of disentanglement in variational autoencoders
Tian Qi Chen, Xuechen Li, Roger Grosse, and David Duvenaud · 2018
Closest in time.
Image-to-image translation for cross-domain disentanglement
Abel Gonzalez-Garcia, Joost van de Weijer, and Yoshua Bengio · 2018
Closest in time.
Boundary-seeking generative adversarial networks
R Devon Hjelm, Athul Paul Jacob, Tong Che, Adam Trischler, Kyunghyun Cho, and Yoshua Bengio · 2018
Closest in time.
Invariant information distillation for unsupervised image segmentation and clustering
Xu Ji, João F Henriques, and Andrea Vedaldi · 2018
Closest in time.
Zhuang Ma and Michael Collins · 2018
Closest in time.
Which training methods for gans do actually converge?
Lars Mescheder, Andreas Geiger, and Sebastian Nowozin · 2018
Closest in time.
Representation learning with contrastive predictive coding
Aaron van den Oord, Yazhe Li, and Oriol Vinyals · 2018
Closest in time.