Fetching the paper…
Reading the bibliography…
Self-supervised learning allows AI systems to learn effective representations from large amounts of data using tasks that do not require costly labeling.
Triangular factorization and inversion by fast matrix multiplication
James R Bunch and John E Hopcroft · 1974
Earlier work this paper cites.
Self-organization in a perceptual network
Ralph Linsker · 1988
Earlier work this paper cites.
Self-organizing neural network that discovers surfaces in random-dot stereograms
Suzanna Becker and Geoffrey E Hinton · 1992
Earlier work this paper cites.
An information-maximization approach to blind separation and blind deconvolution
Anthony J Bell and Terrence J Sejnowski · 1995
Earlier work this paper cites.
Linear estimation
Thomas Kailath, Ali H Sayed, and Babak Hassibi · 2000
Earlier work this paper cites.
Improved baselines with momentum contrastive learning
Xinlei Chen, Haoqi Fan, Ross Girshick, and Kaiming He · 2003
Earlier work this paper cites.
Improved baselines with momentum contrastive learning
Xinlei Chen, Haoqi Fan, Ross Girshick, and Kaiming He · 2003
Earlier work this paper cites.
Elements of information theory
Thomas M. Cover and Joy A. Thomas · 2006
Earlier work this paper cites.
Independent Component Analysis and Blind Signal Separation: 6th International Conference, ICA 2006, Charleston, SC, USA, March 5-8, 2006, Proceedings , volume 3889
Justinian Rosca, Deniz Erdogmus, José C Príncipe, and Simon Haykin · 2006
Earlier work this paper cites.
A unified architecture for natural language processing: Deep neural networks with multitask learning
Ronan Collobert and Jason Weston · 2008
Earlier work this paper cites.
Learning multiple layers of features from tiny images.(2009), 2009
Alex Krizhevsky, Geoffrey Hinton, et al · 2009
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009
Earlier work this paper cites.
A simplex volume maximization framework for hyperspectral endmember extraction
Tsung-Han Chan, Wing-Kin Ma, ArulMurugan Ambikapathi, and Chong-Yung Chi · 2011
Earlier work this paper cites.
A convolutive bounded component analysis framework for potentially nonstationary independent and/or dependent sources
Huseyin A Inan and Alper T Erdogan · 2014
Earlier work this paper cites.
Microsoft COCO: common objects in context
Tsung-Yi Lin, Michael Maire, Serge J. Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick · 2014
Earlier work this paper cites.
Unsupervised visual representation learning by context prediction
Carl Doersch, Abhinav Gupta, and Alexei A Efros · 2015
Earlier work this paper cites.
Tiny imagenet visual recognition challenge
Ya Le and Xuan Yang · 2015
Earlier work this paper cites.
Robust volume minimization-based matrix factorization for remote sensing and document clustering
Xiao Fu, Kejun Huang, Bo Yang, Wing-Kin Ma, and Nicholas D Sidiropoulos · 2016
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Cited alongside, same era.
Mask r-cnn
Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick · 2017
Cited alongside, same era.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Cited alongside, same era.
An empirical model of large-batch training
Sam McCandlish, Jared Kaplan, Dario Amodei, and OpenAI Dota Team · 2018
Cited alongside, same era.
Revisiting small batch training for deep neural networks
Dominic Masters and Carlo Luschi · 2018
Cited alongside, same era.
Formal limitations on the measurement of mutual information
David McAllester and Karl Stratos · 2020
Later among the works it cites.
Momentum contrast for unsupervised visual representation learning
Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross Girshick · 2020
Later among the works it cites.
Hard negative mixing for contrastive learning
Yannis Kalantidis, Mert Bulent Sariyildiz, Noe Pion, Philippe Weinzaepfel, and Diane Larlus · 2020
Later among the works it cites.
Barlow twins: Self-supervised learning via redundancy reduction
Jure Zbontar, Li Jing, Ishan Misra, Yann LeCun, and Stéphane Deny · 2021
Later among the works it cites.
Vicreg: Variance-invariance-covariance regularization for self-supervised learning
Adrien Bardes, Jean Ponce, and Yann LeCun · 2021
Later among the works it cites.
How well do self-supervised models transfer?
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
An algorithmic framework for sparse bounded component analysis
Eren Babatas and Alper T Erdogan · 2018
Cited alongside, same era.
Deep clustering for unsupervised learning of visual features
Mathilde Caron, Piotr Bojanowski, Armand Joulin, and Matthijs Douze · 2018
Cited alongside, same era.
Decorrelated batch normalization
Lei Huang, Dawei Yang, Bo Lang, and Jia Deng · 2018
Cited alongside, same era.
Learning deep representations by mutual information estimation and maximization
R Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Phil Bachman, Adam Trischler, and Yoshua Bengio · 2018
Cited alongside, same era.
On variational bounds of mutual information
Ben Poole, Sherjil Ozair, Aaron Van Den Oord, Alex Alemi, and George Tucker · 2019
Cited alongside, same era.
On mutual information maximization for representation learning
Michael Tschannen, Josip Djolonga, Paul K Rubenstein, Sylvain Gelly, and Mario Lucic · 2019
Cited alongside, same era.
Nonnegative matrix factorization for signal and data analytics: Identifiability, algorithms, and applications
Xiao Fu, Kejun Huang, Nicholas D Sidiropoulos, and Wing-Kin Ma · 2019
Cited alongside, same era.
Linus Ericsson, Henry Gouk, and Timothy M Hospedales · 2021
Later among the works it cites.
Understanding neural networks with logarithm determinant entropy estimator
Zhanghao Zhouyin and Ding Liu · 2021
Later among the works it cites.
Polytopic matrix factorization: Determinant maximization based criterion and identifiability
Gokcan Tatli and Alper T. Erdogan · 2021
Later among the works it cites.
Exploring simple siamese representation learning
Xinlei Chen and Kaiming He · 2021
Later among the works it cites.
Understanding self-supervised learning dynamics without contrastive pairs
Yuandong Tian, Xinlei Chen, and Surya Ganguli · 2021
Later among the works it cites.
Whitening for self-supervised representation learning
Aleksandr Ermolov, Aliaksandr Siarohin, Enver Sangineto, and Nicu Sebe · 2021
Later among the works it cites.
On feature decorrelation in self-supervised learning
Tianyu Hua, Wenxiao Wang, Zihui Xue, Sucheng Ren, Yue Wang, and Hang Zhao · 2021
Later among the works it cites.
Self-supervised learning with kernel dependence maximization
Yazhe Li, Roman Pogodin, Danica J Sutherland, and Arthur Gretton · 2021
Later among the works it cites.
Provable guarantees for self-supervised deep learning with spectral contrastive loss
Jeff Z HaoChen, Colin Wei, Adrien Gaidon, and Tengyu Ma · 2021
Later among the works it cites.
Robust contrastive learning using negative samples with diminished semantics
Songwei Ge, Shlok Mishra, Chun-Liang Li, Haohan Wang, and David Jacobs · 2021
Later among the works it cites.
Improving transferability of representations via augmentation-aware self-supervision
Hankook Lee, Kibok Lee, Kimin Lee, Honglak Lee, and Jinwoo Shin · 2021
Later among the works it cites.
An information maximization based blind source separation approach for dependent and independent sources
Alper T Erdogan · 2022
Closest in time.
Solo-learn: A library of self-supervised methods for visual representation learning
Victor Guilherme Turrisi da Costa, Enrico Fini, Moin Nabi, Nicu Sebe, and Elisa Ricci · 2022
Closest in time.