Fetching the paper…
Reading the bibliography…
Self-supervised learning is a popular and powerful method for utilizing large amounts of unlabeled data, for which a wide variety of training objectives have been proposed in the literature.
R. Linsker, “Self-Organization in a Perceptual Network,” Computer , vol. 21, no. 3, pp. 105–117, 1988
1988
Earlier work this paper cites.
S. Becker and G. Hinton, “Self-Organizing Neural Network that Discovers Surfaces in Random-Dot Stereograms,” Nature , vol. 355, no. 6356, pp. 161–163, 1992
1992
Earlier work this paper cites.
D. Barber and F. Agakov, “The IM Algorithm: A Variational Approach to Information Maximization,” in NeurIPS , 2004
2004
Earlier work this paper cites.
O.Chapelle, B. Schölkopf, and A. Zien, “Semi-Supervised Learning. Adaptive Computation and Machine Learning,” Methods , 2010
2010
Earlier work this paper cites.
M. Cuturi, “Sinkhorn Distances: Lightspeed Computation of Optimal Transport,” in NeurIPS , 2013
2013
Earlier work this paper cites.
J. Xie, Y. Lu, S. C. Zhu, and Y. N. Wu, “A Theory of Generative Convnet,” in ICML , 2016
2016
Earlier work this paper cites.
E. Sansone, A. Passerini, and F. G. D. Natale, “Classtering: Joint Classification and Clustering with Mixture of Factor Analysers,” in ECAI , 2016
2016
Earlier work this paper cites.
R. Manhaeve, S. Dumancic, A. Kimmig, T. Demeester, and L. D. Raedt, “DeepProbLog: Neural Probabilistic Logic Programming,” in NeurIPS , 2018
2018
Earlier work this paper cites.
A. V. den Oord, Y. Li, and O. Vinyals, “Representation Learning with Contrastive Predictive Coding,” in arXiv , 2018
2018
Earlier work this paper cites.
M. Caron, P. Bojanowski, A. Joulin, and M. Douze, “Deep Clustering for Unsupervised Learning of Visual Features,” in ECCV , 2018
2018
Earlier work this paper cites.
M. I. Belghazi, A. Baratin, S. Rajeshwar, S. Ozair, Y. Bengio, A. Courville, and D. Hjelm, “Mutual Information Neural Estimation,” in ICML , 2018
2018
Earlier work this paper cites.
R. D. Hjelm, A. Fedorov, S. Lavoie-Marchildon, K. Grewal, P. Bachman, A. Trischler, and Y. Bengio, “Learning Deep Representations by Mutual Information Estimation and Maximization,” in ICLR , 2018
2018
Earlier work this paper cites.
J. Xu, Z. Zhang, T. Friedman, Y. Liang, and G. Broeck, “A Semantic Loss Function for Deep Learning with Symbolic Knowledge,” in ICML , 2018
2018
Earlier work this paper cites.
A. Alemi, B. Poole, I. Fischer, J. Dillon, R. A. Saurous, and K. Murphy, “Fixing a Broken ELBO,” in ICML , 2018
2018
Earlier work this paper cites.
E. Nalisnick, A. Matsukawa, Y. W. Teh, D. Gorur, and B. Lakshminarayanan, “Do deep generative models know what they don’t know?” in ICLR , 2019
2018
Earlier work this paper cites.
E. Nijkamp, M. Hill, S. C. Zhu, and Y. N. Wu, “Learning non-convergent non-persistent short-run mcmc toward energy-based model,” in NeurIPS , 2019
2019
Earlier work this paper cites.
Y. Du and I. Mordatch, “Implicit Generation and Generalization in Energy-Based Models,” arXiv , 2019
2019
Earlier work this paper cites.
B. Poole, S. Ozair, A. V. D. Oord, A. Alemi, and G. Tucker, “On Variational Bounds of Mutual Information,” in ICML , 2019
2019
Earlier work this paper cites.
M. Tschannen, J. Djolonga, P. K. Rubenstein, S. Gelly, and M. Lucic, “On Mutual Information Maximization for Representation Learning,” in ICLR , 2019
2019
Earlier work this paper cites.
N. Saunshi, O. Plevrakis, S. Arora, M. Khodak, and H. Khandeparkar, “A Theoretical Analysis of Contrastive Unsupervised Representation Learning,” in ICML , 2019
2019
Earlier work this paper cites.
D. Hendrycks, M. Mazeika, S. Kadavath, and D. Song, “Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty,” in NeurIPS , 2019
2019
Earlier work this paper cites.
O. O. Henaff, “Data-Efficient Image Recognition with Contrastive Predictive Coding,” in ICML , 2020
2020
Earlier work this paper cites.
T. Chen, S. Kornblith, M. Norouzi, and G. Hinton, “A Simple Framework for Contrastive Learning of Visual Representations,” in ICML , 2020
2020
Earlier work this paper cites.
M. Caron, I. Misra, J. Mairal, P. Goyal, P. Bojanowski, and A. Joulin, “Unsupervised Learning of Visual Features by Contrasting Cluster Assignments,” in NeurIPS , 2020
2020
Earlier work this paper cites.
W. Grathwohl, K.-C. Wang, J.-H. Jacobsen, D. Duvenaud, M. Norouzi, and K. Swersky, “Your Classifier is Secretly an Energy Based Model and You Should Treat It Like One,” in ICLR , 2020
2020
Cited alongside, same era.
E. Nijkamp, M. Hill, T. Han, S.-C. Zhu, and Y. N. Wu, “On the Anatomy of MCMC-Based Maximum Likelihood Learning of Energy-Based Models,” in AAAI , 2020
2020
Cited alongside, same era.
D. McAllester and K. Stratos, “Formal Limitations on the Measurement of Mutual Information,” in AISTATS , 2020
2020
Cited alongside, same era.
J. Song and S. Ermon, “Understanding the Limitations of Variational Mutual Information Estimators,” ICLR , 2020
2020
Cited alongside, same era.
Y. M. Asano, C. Rupprecht, and A. Vedaldi, “Self-Labelling via Simultaneous Clustering and Representation Learning,” in ICLR , 2020
2020
Cited alongside, same era.
H. Xu, H. Xiong, and G. J. Qi, “K-Shot Contrastive Learning of Visual Features with Multiple Instance Augmentations,” IEEE Transactions on Pattern Analysis and Machine Intelligence , 2022
2022
Closest in time.
S. Ozsoy, S. Hamdan, S. Arik, D. Yuret, and A. T. Erdogan, “Self-Supervised Learning with an Information Maximization Criterion,” in NeurIPS , 2022
2022
Closest in time.
X. Liu, Z. Wang, Y. Li, and S. Wang, “Self-Supervised Learning via Maximum Entropy Coding,” in NeurIPS , 2022
2022
Closest in time.
A. Bardes, J. Ponce, and Y. Lecun, “VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning,” in ICLR , 2022
2022
Closest in time.
A. Bardes, J. Ponce, and Y. LeCun, “VICREGL: Self-Supervised Learning of Local Visual Features,” in NeurIPS , 2022
2022
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
J. B. Grill, F. Strub, F. Altché, C. Tallec, P. H. Richemond, E. Buchatskaya, C. Doersch, B. A. Pires, Z. D. Guo, M. G. Azar et al. , “Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning,” in NeurIPS , 2020
2020
Cited alongside, same era.
H. Liu and P. Abbeel, “Hybrid Discriminative-Generative Training via Contrastive Learning,” in arXiv , 2020
2020
Cited alongside, same era.
T. Wang and P. Isola, “Understanding Contrastive Representation Learning Through Alignment and Uniformity on the Hypersphere,” in ICML , 2020
2020
Cited alongside, same era.
J. Winkens, R. Bunel, A. G. Roy, R. Stanforth, V. Natarajan, J. R. Ledsam, P. MacWilliams, P. Kohli, A. Karthikesalingam, S. Kohl et al. , “Contrastive Training for Improved Out-of-Distribution Detection,” in arXiv , 2020
2020
Cited alongside, same era.
S. Mohseni, M. Pitale, J. B. S. Yadawa, and Z. Wang, “Self-Supervised Learning for Generalizable Out-of-Distribution Detection,” in AAAI , 2020
2020
Cited alongside, same era.
J. Zbontar, L. Jing, I. Misra, Y. LeCun, and S. Deny, “Barlow Twins: Self-Supervised Learning via Redundancy Reduction,” in ICML , 2021
2021
Cited alongside, same era.
A. Ermolov, A. Siarohin, E. Sangineto, and N. Sebe, “Whitening for Self-Supervised Representation Learning,” in ICML , 2021
2021
Cited alongside, same era.
B. Kim and J. C. Ye, “Energy-Based Contrastive Learning of Visual Representations,” in NeurIPS , 2022
2022
Closest in time.
N. Tomasev, I. Bica, B. McWilliams, L. Buesing, R. Pascanu, C. Blundell, and J. Mitrovic, “Pushing the Limits of Self-Supervised ResNets: Can We Outperform Supervised Learning Without Labels on ImageNet?” in ICML Pre-Training Workshop , 2022
2022
Closest in time.
F. Scherr, Q. Guo, and T. Moraitis, “Self-Supervised Learning Through Efference Copies,” in NeurIPS , 2022
2022
Closest in time.
Z. Huang, J. Chen, J. Zhang, and H. Shan, “Learning Representation for Clustering Via Prototype Scattering and Positive Sampling,” IEEE Transactions on Pattern Analysis and Machine Intelligence , 2022
2022
Closest in time.
Q. Garrido, Y. Chen, A. Bardes, L. Najman, and Y. Lecun, “On the Duality Between Contrastive and Non-Contrastive Self-Supervised Learning,” arXiv , 2022
2022
Closest in time.
Z. Li, Y. Chen, Y. LeCun, and F. T. Sommer, “Neural Manifold Clustering and Embedding,” in arXiv , 2022
2022
Closest in time.
N. Saunshi, J. Ash, S. Goel, D. Misra, C. Zhang, S. Arora, S. Kakade, and A. Krishnamurthy, “Understanding Contrastive Learning Requires Incorporating Inductive Biases,” in ICML , 2022
2022
Closest in time.
L. Kang-Jun, S. Masanori, and O. Takayuki, “Bridging the Gap from Asymmetry Tricks to Decorrelation Principles in Non-contrastive Self-Supervised Learning,” in NeurIPS , 2022
2022
Closest in time.
X. Weng, L. Huang, L. Zhao, R. M. Anwer, S. Khan, and F. S. Khan, “An Investigation into Whitening Loss for Self-supervised Learning,” in NeurIPS , 2022
2022
Closest in time.
Z. Wen and Y. Li, “The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning,” in NeurIPS , 2022
2022
Closest in time.
H. Bao, Y. Nagano, and K. Nozawa, “On the Surrogate Gap between Contrastive and Supervised Losses,” in ICML , 2022
2022
Closest in time.
Y. Dubois, T. Hashimoto, S. Ermon, and P. Liang, “Improving Self-Supervised Learning by Characterizing Idealized Representations,” in NeurIPS , 2022
2022
Closest in time.
R. Balestriero and Y. LeCun, “Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods,” in NeurIPS , 2022
2022
Closest in time.
X. Wang and G. J. Qi, “Contrastive Learning with Stronger Augmentations,” IEEE Transactions on Pattern Analysis and Machine Intelligence , 2022
2022
Closest in time.
K. Yang, T. Zhou, X. Tian, and D. Tao, “Identity-Disentangled Adversarial Augmentation for Self-Supervised Learning,” in ICML , 2022
2022
Closest in time.
Y. Shi, N. Siddharth, P. Torr, and A. R. Kosiorek, “Adversarial Masking for Self-Supervised Learning,” in ICML , 2022
2022
Closest in time.
J. Li, W. Qiang, C. Zheng, B. Su, and H. Xiong, “MetAug: Contrastive Learning via Meta Feature Augmentation,” in ICML , 2022
2022
Closest in time.
Y. LeCun, “A Path Towards Autonomous Machine Intelligence,” 2022
2022
Closest in time.
V. G. T. da Costa, E. Fini, M. Nabi, N. Sebe, and E. Ricci, “Solo-learn: A Library of Self-supervised Methods for Visual Representation Learning,” JMLR , vol. 23, no. 56, pp. 1–6, 2022
2022
Closest in time.