Fetching the paper…
Reading the bibliography…
Input space reconstruction is an attractive representation learning paradigm.
Principal component analysis
Wold, S., Esbensen, K., and Geladi, P · 1987
Earlier work this paper cites.
Unsupervised learning
Barlow, H. B · 1989
Earlier work this paper cites.
Modelling the power spectra of natural images: statistics and information
Van der Schaaf, v. A. and van Hateren, J. v · 1996
Earlier work this paper cites.
Origins of scaling in natural images
Ruderman, D. L · 1997
Earlier work this paper cites.
Preconditioning techniques for large linear systems: a survey
Benzi, M · 2002
Earlier work this paper cites.
Unsupervised learning
Ghahramani, Z · 2003
Earlier work this paper cites.
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P · 2004
Earlier work this paper cites.
Estimation of non-normalized statistical models by score matching
Hyvärinen, A. and Dayan, P · 2005
Earlier work this paper cites.
Power iteration method for the several largest eigenvalues and eigenfunctions
Booth, T. E · 2006
Earlier work this paper cites.
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Gutmann, M. and Hyvärinen, A · 2010
Earlier work this paper cites.
Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion
Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.-A., and Bottou, L · 2010
Earlier work this paper cites.
Stochastic gradient descent tricks
Bottou, L · 2012
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., and Hinton, G. E · 2012
Earlier work this paper cites.
Auto-encoding variational bayes
Kingma, D. P. and Welling, M · 2013
Earlier work this paper cites.
Metric learning: A survey
Kulis, B. et al · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
Kingma, D. P. and Ba, J · 2014
Earlier work this paper cites.
Visualizing and understanding convolutional networks
Zeiler, M. D. and Fergus, R · 2014
Cited alongside, same era.
Deep learning
LeCun, Y., Bengio, Y., and Hinton, G · 2015
Cited alongside, same era.
Understanding deep image representations by inverting them
Mahendran, A. and Vedaldi, A · 2015
Cited alongside, same era.
End-to-end optimization of nonlinear transform codes for perceptual quality
Ballé, J., Laparra, V., and Simoncelli, E. P · 2016
Cited alongside, same era.
Deep unsupervised clustering with gaussian mixture variational autoencoders
Dilokthanakul, N., Mediano, P. A., Garnelo, M., Lee, M. C., Salimbeni, H., Arulkumaran, K., and Shanahan, M · 2016
Cited alongside, same era.
Variational deep embedding: An unsupervised and generative approach to clustering
On the spectral bias of neural networks
Rahaman, N., Baratin, A., Arpit, D., Draxler, F., Lin, M., Hamprecht, F., Bengio, Y., and Courville, A · 2019
Later among the works it cites.
Big self-supervised models are strong semi-supervised learners
Chen, T., Kornblith, S., Swersky, K., Norouzi, M., and Hinton, G. E · 2020
Later among the works it cites.
Deep clustering with variational autoencoder
Lim, K.-L., Jiang, X., and Yi, C · 2020
Later among the works it cites.
Clustering earthquake signals and background noises in continuous seismic data with unsupervised deep learning
Seydoux, L., Balestriero, R., Poli, P., Hoop, M. d., Campillo, M., and Baraniuk, R · 2020
Later among the works it cites.
Interpreting the latent space of gans for semantic face editing
Shen, Y., Gu, J., Tang, X., and Zhou, B · 2020
Later among the works it cites.
Vicreg: Variance-invariance-covariance regularization for self-supervised learning
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Jiang, Z., Zheng, Y., Tan, H., Tang, B., and Zhou, H · 2016
Cited alongside, same era.
Grad-cam: Why did you say that?
Selvaraju, R. R., Das, A., Vedantam, R., Cogswell, M., Parikh, D., and Batra, D · 2016
Cited alongside, same era.
Conditional image generation with pixelcnn decoders
Van den Oord, A., Kalchbrenner, N., Espeholt, L., Vinyals, O., Graves, A., et al · 2016
Cited alongside, same era.
Cvae-gan: fine-grained image generation through asymmetric training
Bao, J., Chen, D., Wen, F., Li, H., and Hua, G · 2017
Cited alongside, same era.
Feature visualization
Olah, C., Mordvintsev, A., and Schubert, L · 2017
Cited alongside, same era.
Disentangled representation learning gan for pose-invariant face recognition
Tran, L., Yin, X., and Liu, X · 2017
Cited alongside, same era.
Pixelsnail: An improved autoregressive generative model
Chen, X., Mishra, N., Rohaninejad, M., and Abbeel, P · 2018
Cited alongside, same era.
Bardes, A., Ponce, J., and LeCun, Y · 2021
Later among the works it cites.
High fidelity visualization of what your self-supervised representation knows about
Bordes, F., Balestriero, R., and Vincent, P · 2021
Later among the works it cites.
On the frequency bias of generative models
Schwarz, K., Liao, Y., and Geiger, A · 2021
Later among the works it cites.
Barlow twins: Self-supervised learning via redundancy reduction
Zbontar, J., Jing, L., Misra, I., LeCun, Y., and Deny, S · 2021
Later among the works it cites.
A data-augmentation is worth a thousand samples: Analytical moments and sampling-free training
Balestriero, R., Misra, I., and LeCun, Y · 2022
Later among the works it cites.
Masked autoencoders are scalable vision learners
He, K., Chen, X., Xie, S., Li, Y., Dollár, P., and Girshick, R · 2022
Later among the works it cites.
Education in the era of generative artificial intelligence (ai): Understanding the potential benefits of chatgpt in promoting teaching and learning
Baidoo-Anu, D. and Ansah, L. O · 2023
Later among the works it cites.
A cookbook of self-supervised learning
Balestriero, R., Ibrahim, M., Sobal, V., Morcos, A., Shekhar, S., Goldstein, T., Bordes, F., Bardes, A., Mialon, G., Tian, Y., et al · 2023
Later among the works it cites.
Generative ai at work
Brynjolfsson, E., Li, D., and Raymond, L. R · 2023
Later among the works it cites.
Rankme: Assessing the downstream performance of pretrained self-supervised representations by their rank
Garrido, Q., Balestriero, R., Najman, L., and Lecun, Y · 2023
Later among the works it cites.