Fetching the paper…
Reading the bibliography…
Most of the current self-supervised representation learning (SSL) methods are based on the contrastive loss and the instance-discrimination task, where augmented versions of the same image instance ("positives") are contrasted with instances extracted from other images ("negatives").
The jackknife, the bootstrap, and other resampling plans , volume 38
Efron, B · 1982
Earlier work this paper cites.
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., and Hinton, G · 2002
Earlier work this paper cites.
Improved baselines with momentum contrastive learning
Chen, X., Fan, H., Girshick, R. B., and He, K · 2003
Earlier work this paper cites.
Cholesky factorization of matrices in parallel and ranking of graphs
Dereniowski, D. and Marek, K · 2004
Earlier work this paper cites.
Big self-supervised models are strong semi-supervised learners
Chen, T., Kornblith, S., Swersky, K., Norouzi, M., and Hinton, G · 2006
Earlier work this paper cites.
Dimensionality reduction by learning an invariant mapping
Hadsell, R., Chopra, S., and LeCun, Y · 2006
Earlier work this paper cites.
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P · 2008
Earlier work this paper cites.
ImageNet: A Large-Scale Hierarchical Image Database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L · 2009
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Krizhevsky, A. and Hinton, G · 2009
Earlier work this paper cites.
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Gutmann, M. and Hyvärinen, A · 2010
Earlier work this paper cites.
Understanding self-supervised learning with dual deep networks
Tian, Y., Yu, L., Chen, X., and Ganguli, S · 2010
Earlier work this paper cites.
An analysis of single-layer networks in unsupervised feature learning
Coates, A., Ng, A. Y., and Lee, H · 2011
Earlier work this paper cites.
Adam: A method for stochastic optimization
Kingma, D. P. and Ba, J · 2014
Earlier work this paper cites.
Batch normalization: Accelerating deep network training by reducing internal covariate shift
Ioffe, S. and Szegedy, C · 2015
Earlier work this paper cites.
Tiny imagenet visual recognition challenge
Le, Y. and Yang, X · 2015
Earlier work this paper cites.
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., and Philbin, J · 2015
Earlier work this paper cites.
Unsupervised learning of visual representations using videos
Wang, X. and Gupta, A · 2015
Earlier work this paper cites.
CliqueCNN: deep unsupervised exemplar learning
Bautista, M. A., Sanakoyeu, A., Tikhoncheva, E., and Ommer, B · 2016
Cited alongside, same era.
Deep residual learning for image recognition
He, K., Zhang, X., Ren, S., and Sun, J · 2016
Cited alongside, same era.
Shuffle and learn: Unsupervised learning using temporal order verification
Misra, I., Zitnick, C. L., and Hebert, M · 2016
Cited alongside, same era.
Unsupervised learning of visual representations by solving jigsaw puzzles
Noroozi, M. and Favaro, P · 2016
Cited alongside, same era.
Context encoders: Feature learning by inpainting
Pathak, D., Krähenbühl, P., Donahue, J., Darrell, T., and Efros, A. A · 2016
Cited alongside, same era.
Improved deep metric learning with multi-class n-pair loss objective
Sohn, K · 2016
Cited alongside, same era.
Temporal cycle-consistency learning
Dwibedi, D., Aytar, Y., Tompson, J., Sermanet, P., and Zisserman, A · 2019
Later among the works it cites.
Momentum contrast for unsupervised visual representation learning
He, K., Fan, H., Wu, Y., Xie, S., and Girshick, R · 2019
Later among the works it cites.
Data-efficient image recognition with contrastive predictive coding
Hénaff, O. J., Razavi, A., Doersch, C., Eslami, S. M. A., and van den Oord, A · 2019
Later among the works it cites.
Learning deep representations by mutual information estimation and maximization
Hjelm, R. D., Fedorov, A., Lavoie-Marchildon, S., Grewal, K., Bachman, P., Trischler, A., and Bengio, Y · 2019
Later among the works it cites.
Invariant information clustering for unsupervised image classification and segmentation
Ji, X., Henriques, J. F., and Vedaldi, A · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Adversarial feature learning
Donahue, J., Krähenbühl, P., and Darrell, T · 2017
Cited alongside, same era.
In defense of the triplet loss for person re-identification
Hermans, A., Beyer, L., and Leibe, B · 2017
Cited alongside, same era.
Large batch training of convolutional networks
You, Y., Gitman, I., and Ginsburg, B · 2017
Cited alongside, same era.
Deep clustering for unsupervised learning of visual features
Caron, M., Bojanowski, P., Joulin, A., and Douze, M · 2018
Cited alongside, same era.
Decorrelated batch normalization
Huang, L., Yang, D., Lang, B., and Deng, J · 2018
Cited alongside, same era.
Representation learning with contrastive predictive coding
van den Oord, A., Li, Y., and Vinyals, O · 2018
Cited alongside, same era.
Self-supervised learning of pretext-invariant representations
Misra, I. and van der Maaten, L · 2019
Later among the works it cites.
Whitening and coloring transform for GANs
Siarohin, A., Sangineto, E., and Sebe, N · 2019
Later among the works it cites.
On mutual information maximization for representation learning
Tschannen, M., Djolonga, J., Rubenstein, P. K., Gelly, S., and Lucic, M · 2019
Later among the works it cites.
Local aggregation for unsupervised learning of visual embeddings
Zhuang, C., Zhai, A. L., and Yamins, D · 2019
Later among the works it cites.
Unsupervised learning of visual features by contrasting cluster assignments
Caron, M., Misra, I., Mairal, J., Goyal, P., Bojanowski, P., and Joulin, A · 2020
Closest in time.
Exploring simple siamese representation learning
Chen, X. and He, K · 2020
Closest in time.
Understanding self-supervised and contrastive learning with bootstrap your own latent (BYOL)
Fetterman, A. and Albrecht, J · 2020
Closest in time.
Bootstrap your own latent: A new approach to self-supervised learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., Piot, B., Kavukcuoglu, K., Munos, R., and Valko, M · 2020
Closest in time.
Byol works even without batch statistics
Richemond, P. H., Grill, J.-B., Altché, F., Tallec, C., Strub, F., Brock, A., Smith, S., De, S., Pascanu, R., Piot, B., and Valko, M · 2020
Closest in time.
Understanding contrastive representation learning through alignment and uniformity on the hypersphere
Wang, T. and Isola, P · 2020
Closest in time.
3D human shape and pose from a single low-resolution image with self-supervised learning
Xu, X., Chen, H., Moreno-Noguer, F., Jeni, L. A., and la Torre, F. D · 2020
Closest in time.