Fetching the paper…
Reading the bibliography…
Recent progress has been made towards learning invariant or equivariant representations with self-supervised learning.
View-dependent object recognition by monkeys
Logothetis, N., Pauls, J., Bülthoff, H., and Poggio, T · 1994
Earlier work this paper cites.
Contrastive learning inverts the data generating process
Zimmermann, R. S., Sharma, Y., Schneider, S., Bethge, M., and Brendel, W · 2000
Earlier work this paper cites.
Improved baselines with momentum contrastive learning
Chen, X., Fan, H., Girshick, R., and He, K · 2003
Earlier work this paper cites.
What Should Not Be Contrastive in Contrastive Learning, March 2021
Xiao, T., Wang, X., Efros, A. A., and Darrell, T · 2008
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L · 2009
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Krizhevsky, A., Hinton, G., et al · 2009
Earlier work this paper cites.
Transforming auto-encoders
Hinton, G. E., Krizhevsky, A., and Wang, S. D · 2011
Earlier work this paper cites.
Adam: A method for stochastic optimization
Kingma, D. P. and Ba, J · 2014
Earlier work this paper cites.
Shapenet: An information-rich 3d model repository
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al · 2015
Earlier work this paper cites.
Group equivariant convolutional networks
Cohen, T. and Welling, M · 2016
Earlier work this paper cites.
Ha, D., Dai, A., and Le, Q. V · 2016
Earlier work this paper cites.
Deep residual learning for image recognition
He, K., Zhang, X., Ren, S., and Sun, J · 2016
Earlier work this paper cites.
Deep clustering for unsupervised learning
Caron, M., Bojanowski, P., Joulin, A., and Douze, M · 2018
Earlier work this paper cites.
Cohen, T. S., Geiger, M., Köhler, J., and Welling, M · 2018
Earlier work this paper cites.
Explorations in homeomorphic variational auto-encoding
Falorsi, L., De Haan, P., Davidson, T. R., De Cao, N., Weiler, M., Forré, P., and Cohen, T. S · 2018
Earlier work this paper cites.
Unsupervised representation learning by predicting image rotations
Gidaris, S., Singh, P., and Komodakis, N · 2018
Cited alongside, same era.
Representation learning with contrastive predictive coding
Oord, A. v. d., Li, Y., and Vinyals, O · 2018
Cited alongside, same era.
Denninger, M., Sundermeyer, M., Winkelbauer, D., Zidan, Y., Olefir, D., Elbadrawy, M., Lodhi, A., and Katam, H · 2019
Cited alongside, same era.
Contrastive learning of structured world models
Kipf, T., Van der Pol, E., and Welling, M · 2019
Cited alongside, same era.
Unsupervised learning of visual features by contrasting cluster assignments
Caron, M., Misra, I., Mairal, J., Goyal, P., Bojanowski, P., and Joulin, A · 2020
Cited alongside, same era.
Decoupled contrastive learning
Yeh, C.-H., Hong, C.-Y., Hsu, Y.-C., Liu, T.-L., Chen, Y., and LeCun, Y · 2021
Later among the works it cites.
Barlow twins: Self-supervised learning via redundancy reduction
Zbontar, J., Jing, L., Misra, I., LeCun, Y., and Deny, S · 2021
Later among the works it cites.
VICRegl: Self-supervised learning of local visual features
Bardes, A., Ponce, J., and LeCun, Y · 2022
Later among the works it cites.
Guillotine regularization: Improving deep networks generalization by removing their head
Bordes, F., Balestriero, R., Garrido, Q., Bardes, A., and Vincent, P · 2022
Later among the works it cites.
Equimod: An equivariance module to improve self-supervised learning
Devillers, A. and Lefort, M · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Exploring simple siamese representation learning
Chen, X. and He, K · 2020
Cited alongside, same era.
Bootstrap your own latent: A new approach to self-supervised learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., Piot, B., Kavukcuoglu, K., Munos, R., and Valko, M · 2020
Cited alongside, same era.
Momentum contrast for unsupervised visual representation learning
He, K., Fan, H., Wu, Y., Xie, S., and Girshick, R · 2020
Cited alongside, same era.
Vicreg: Variance-invariance-covariance regularization for self-supervised learning
Bardes, A., Ponce, J., and LeCun, Y · 2021
Cited alongside, same era.
Emerging properties in self-supervised vision transformers
Caron, M., Touvron, H., Misra, I., Jegou, H., Mairal, J., Bojanowski, P., and Joulin, A · 2021
Cited alongside, same era.
An empirical study of training self-supervised vision transformers
Chen, X., Xie, S., and He, K · 2021
Cited alongside, same era.
Equivariant contrastive learning
Dangovski, R., Jing, L., Loh, C., Han, S., Srivastava, A., Cheung, B., Agrawal, P., and Soljačić, M · 2021
Cited alongside, same era.
On the duality between contrastive and non-contrastive self-supervised learning
Garrido, Q., Chen, Y., Bardes, A., Najman, L., and Lecun, Y · 2022
Later among the works it cites.
Masked autoencoders are scalable vision learners
He, K., Chen, X., Xie, S., Li, Y., Dollár, P., and Girshick, R · 2022
Later among the works it cites.
Equivariant representation learning via class-pose decomposition
Marchetti, G. L., Tegnér, G., Varava, A., and Kragic, D · 2022
Later among the works it cites.
Learning Symmetric Embeddings for Equivariant World Models, June 2022
Park, J. Y., Biza, O., Zhao, L., van de Meent, J. W., and Walters, R · 2022
Later among the works it cites.
Self-supervised learning through efference copies
Scherr, F., Guo, Q., and Moraitis, T · 2022
Later among the works it cites.
Structuring representations using group invariants
Shakerinava, M., Mondal, A. K., and Ravanbakhsh, S · 2022
Later among the works it cites.
Tomasev, N., Bica, I., McWilliams, B., Buesing, L., Pascanu, R., Blundell, C., and Mitrovic, J · 2022
Later among the works it cites.
Unsupervised learning of group invariant and equivariant representations
Winter, R., Bertolini, M., Le, T., Noe, F., and Clevert, D.-A · 2022
Later among the works it cites.
What should be equivariant in self-supervised learning
Xie, Y., Wen, J., Lau, K. W., Rehman, Y. A. U., and Shen, J · 2022
Later among the works it cites.
3d warehouse
Trimble Inc · 2023
Closest in time.