Fetching the paper…
Reading the bibliography…
Here, we show that the InfoNCE objective is equivalent to the ELBO in a new class of probabilistic generative model, the recognition parameterised model (RPM).
Maximum likelihood and covariant algorithms for independent component analysis, 1996
David JC MacKay · 1996
Earlier work this paper cites.
Maximum likelihood blind source separation: A context-sensitive generalization of ica
Barak Pearlmutter and Lucas Parra · 1996
Earlier work this paper cites.
Probabilistic principal component analysis
Michael E Tipping and Christopher M Bishop · 1999
Earlier work this paper cites.
Latent dirichlet allocation
David M Blei, Andrew Y Ng, and Michael I Jordan · 2003
Earlier work this paper cites.
Auto-encoding variational bayes
Diederik P Kingma and Max Welling · 2013
Earlier work this paper cites.
Stochastic backpropagation and approximate inference in deep generative models
Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra · 2014
Earlier work this paper cites.
Unsupervised visual representation learning by context prediction
Carl Doersch, Abhinav Gupta, and Alexei A Efros · 2015
Earlier work this paper cites.
Discriminative unsupervised feature learning with exemplar convolutional neural networks
Alexey Dosovitskiy, Philipp Fischer, Jost Tobias Springenberg, Martin Riedmiller, and Thomas Brox · 2015
Earlier work this paper cites.
Bayesian representation learning with oracle constraints
Theofanis Karaletsos, Serge Belongie, and Gunnar Rätsch · 2015
Earlier work this paper cites.
Deep unsupervised learning using nonequilibrium thermodynamics
Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli · 2015
Earlier work this paper cites.
beta-vae: Learning basic visual concepts with a constrained variational framework
Irina Higgins, Loic Matthey, Arka Pal, Christopher Burgess, Xavier Glorot, Matthew Botvinick, Shakir Mohamed, and Alexander Lerchner · 2016
Earlier work this paper cites.
Unsupervised learning of visual representations by solving jigsaw puzzles
Mehdi Noroozi and Paolo Favaro · 2016
Earlier work this paper cites.
Fixing a broken elbo
Alexander Alemi, Ben Poole, Ian Fischer, Joshua Dillon, Rif A Saurous, and Kevin Murphy · 2018
Earlier work this paper cites.
Understanding disentangling in β \beta -vae
Christopher P Burgess, Irina Higgins, Arka Pal, Loic Matthey, Nick Watters, Guillaume Desjardins, and Alexander Lerchner · 2018
Earlier work this paper cites.
Isolating sources of disentanglement in variational autoencoders
Ricky TQ Chen, Xuechen Li, Roger Grosse, and David Duvenaud · 2018
Cited alongside, same era.
Unsupervised representation learning by predicting image rotations
Spyros Gidaris, Praveer Singh, and Nikos Komodakis · 2018
Cited alongside, same era.
Disentangling by factorising
Hyunjik Kim and Andriy Mnih · 2018
Cited alongside, same era.
Representation learning with contrastive predictive coding
Aaron van den Oord, Yazhe Li, and Oriol Vinyals · 2018
Cited alongside, same era.
Your classifier is secretly an energy based model and you should treat it like one
Will Grathwohl, Kuan-Chieh Wang, Jörn-Henrik Jacobsen, David Duvenaud, Mohammad Norouzi, and Kevin Swersky · 2019
Capturing label characteristics in vaes
Tom Joy, Sebastian Schmon, Philip Torr, N Siddharth, and Tom Rainforth · 2020
Later among the works it cites.
Survae flows: Surjections to bridge the gap between vaes and flows
Didrik Nielsen, Priyank Jaini, Emiel Hoogeboom, Ole Winther, and Max Welling · 2020
Later among the works it cites.
Understanding contrastive representation learning through alignment and uniformity on the hypersphere
Tongzhou Wang and Phillip Isola · 2020
Later among the works it cites.
Bayesian graph contrastive learning
Arman Hasanzadeh, Mohammadreza Armandpour, Ehsan Hajiramezanali, Mingyuan Zhou, Nick Duffield, and Krishna Narayanan · 2021
Closest in time.
Variational diffusion models
Diederik Kingma, Tim Salimans, Ben Poole, and Jonathan Ho · 2021
Closest in time.
Self-supervised learning with kernel dependence maximization
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
An introduction to variational autoencoders
Diederik P Kingma, Max Welling, et al · 2019
Cited alongside, same era.
Disentangling disentanglement in variational autoencoders
Emile Mathieu, Tom Rainforth, Nana Siddharth, and Yee Whye Teh · 2019
Cited alongside, same era.
On variational bounds of mutual information
Ben Poole, Sherjil Ozair, Aaron Van Den Oord, Alex Alemi, and George Tucker · 2019
Cited alongside, same era.
On mutual information maximization for representation learning
Michael Tschannen, Josip Djolonga, Paul K Rubenstein, Sylvain Gelly, and Mario Lucic · 2019
Cited alongside, same era.
Infovae: Balancing learning and inference in variational autoencoders
Shengjia Zhao, Jiaming Song, and Stefano Ermon · 2019
Cited alongside, same era.
Ncp-vae: Variational autoencoders with noise contrastive priors
Jyoti Aneja, Alexander Schwing, Jan Kautz, and Arash Vahdat · 2020
Cited alongside, same era.
A simple framework for contrastive learning of visual representations
Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton · 2020
Cited alongside, same era.
Yazhe Li, Roman Pogodin, Danica J Sutherland, and Arthur Gretton · 2021
Closest in time.
Maximum likelihood training of score-based diffusion models
Yang Song, Conor Durkan, Iain Murray, and Stefano Ermon · 2021
Closest in time.
Self-supervised learning with data augmentations provably isolates content from style
Julius von Kügelgen, Yash Sharma, Luigi Gresele, Wieland Brendel, Bernhard Schölkopf, Michel Besserve, and Francesco Locatello · 2021
Closest in time.
Contrastive learning inverts the data generating process
Roland S Zimmermann, Yash Sharma, Steffen Schneider, Matthias Bethge, and Wieland Brendel · 2021
Closest in time.
Probabilistic machine learning: an introduction
Kevin P Murphy · 2022
Closest in time.
Contrastvae: Contrastive variational autoencoder for sequential recommendation
Yu Wang, Hengrui Zhang, Zhiwei Liu, Liangwei Yang, and Philip S Yu · 2022
Closest in time.
Generalized variational inference in function spaces: Gaussian measures meet bayesian deep learning
Veit David Wild, Robert Hu, and Dino Sejdinovic · 2022
Closest in time.
Contrastive meta-learning for partially observable few-shot learning
Adam Jelley, Amos Storkey, Antreas Antoniou, and Sam Devlin · 2023
Closest in time.