Fetching the paper…
Reading the bibliography…
A mainstream type of current self-supervised learning methods pursues a general-purpose representation that can be well transferred to downstream tasks, typically by optimizing on a given pretext task such as instance discrimination.
“Asynchronous methods for deep reinforcement learning”
Volodymyr Mnih et al · 1937
Earlier work this paper cites.
“A mathematical theory of communication”
Claude Shannon · 1948
Earlier work this paper cites.
“Information theory and statistical mechanics”
Edwin Jaynes · 1957
Earlier work this paper cites.
“Information theory and statistical mechanics. II”
Edwin Jaynes · 1957
Earlier work this paper cites.
“Generalized principal component analysis (GPCA)”
Rene Vidal, Yi Ma and Shankar Sastry · 1959
Earlier work this paper cites.
“Self-organization in a perceptual network”
Ralph Linsker · 1988
Earlier work this paper cites.
“Maximum-entropy models in science and engineering”
Jagat Kapur · 1989
Earlier work this paper cites.
“Function optimization using connectionist reinforcement learning algorithms”
Ronald Williams and Jing Peng · 1991
Earlier work this paper cites.
“Signature verification using a" siamese" time delay neural network”
Jane Bromley et al · 1993
Earlier work this paper cites.
“Nonparametric entropy estimation: An overview”
Jan Beirlant, Edward Dudewicz, László Györfi and Edward Van · 1997
Earlier work this paper cites.
“Elements of information theory”
Thomas Cover · 1999
Earlier work this paper cites.
“Statistical mechanics of a collisionless system based on the maximum entropy principle”
Tadas Nakamura · 2000
Earlier work this paper cites.
“Parameter estimation for a computable general equilibrium model: a maximum entropy approach”
Channing Arndt, Sherman Robinson and Finn Tarp · 2002
Earlier work this paper cites.
“Estimation of entropy and mutual information”
Liam Paninski · 2003
Earlier work this paper cites.
“Segmentation of multivariate mixed data via lossy data coding and compression”
Yi Ma, Harm Derksen, Wei Hong and John Wright · 2007
Earlier work this paper cites.
“Visualizing data using t-SNE.”
Laurens Van and Geoffrey Hinton · 2008
Earlier work this paper cites.
“Imagenet: A large-scale hierarchical image database”
Jia Deng et al · 2009
Earlier work this paper cites.
“Learning Multiple Layers of Features from Tiny Images”
A Krizhevsky · 2009
Earlier work this paper cites.
“Pac-bayes analysis of maximum entropy classification”
John Shawe-Taylor and David Hardoon · 2009
Earlier work this paper cites.
“The pascal visual object classes (voc) challenge”
Mark Everingham et al · 2010
Earlier work this paper cites.
“Rectified linear units improve restricted boltzmann machines”
Vinod Nair and Geoffrey Hinton · 2010
Earlier work this paper cites.
“Matrix analysis”
Roger Horn and Charles Johnson · 2012
Earlier work this paper cites.
“Principles of maximum entropy and maximum caliber in statistical physics”
Steve Pressé, Kingshuk Ghosh, Julian Lee and Ken Dill · 2013
Earlier work this paper cites.
“Online object tracking: A benchmark”
Yi Wu, Jongwoo Lim and Ming-Hsuan Yang · 2013
Earlier work this paper cites.
“Discriminative unsupervised feature learning with convolutional neural networks”
Alexey Dosovitskiy, Jost Springenberg, Martin Riedmiller and Thomas Brox · 2014
Earlier work this paper cites.
“Microsoft coco: Common objects in context”
Tsung-Yi Lin et al · 2014
Earlier work this paper cites.
“Deepface: Closing the gap to human-level performance in face verification”
Yaniv Taigman, Ming Yang, Marc’Aurelio Ranzato and Lior Wolf · 2014
Earlier work this paper cites.
“Unsupervised visual representation learning by context prediction”
Carl Doersch, Abhinav Gupta and Alexei Efros · 2015
Earlier work this paper cites.
“Batch normalization: Accelerating deep network training by reducing internal covariate shift”
Sergey Ioffe and Christian Szegedy · 2015
Earlier work this paper cites.
“Faster r-cnn: Towards real-time object detection with region proposal networks”
Shaoqing Ren, Kaiming He, Ross Girshick and Jian Sun · 2015
Earlier work this paper cites.
“Fully-convolutional siamese networks for object tracking”
Luca Bertinetto et al · 2016
Cited alongside, same era.
“Deep residual learning for image recognition”
Kaiming He, Xiangyu Zhang, Shaoqing Ren and Jian Sun · 2016
Cited alongside, same era.
“Sgdr: Stochastic gradient descent with warm restarts”
Ilya Loshchilov and Frank Hutter · 2016
Cited alongside, same era.
“MOT16: A benchmark for multi-object tracking”
Anton Milan et al · 2016
Cited alongside, same era.
“Unsupervised learning of visual representations by solving jigsaw puzzles”
Mehdi Noroozi and Paolo Favaro · 2016
Cited alongside, same era.
“Context encoders: Feature learning by inpainting”
“Improved baselines with momentum contrastive learning”
Xinlei Chen, Haoqi Fan, Ross Girshick and Kaiming He · 2020
Later among the works it cites.
“An image is worth 16x16 words: Transformers for image recognition at scale”
Alexey Dosovitskiy et al · 2020
Later among the works it cites.
“Bootstrap your own latent-a new approach to self-supervised learning”
Jean-Bastien Grill et al · 2020
Later among the works it cites.
“Momentum contrast for unsupervised visual representation learning”
Kaiming He et al · 2020
Later among the works it cites.
“Maximum entropy economics”
Ellis Scharfenaker and Jangho Yang · 2020
Later among the works it cites.
“Contrastive multiview coding”
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Deepak Pathak et al · 2016
Cited alongside, same era.
“A benchmark dataset and evaluation methodology for video object segmentation”
Federico Perazzi et al · 2016
Cited alongside, same era.
“Colorful image colorization”
Richard Zhang, Phillip Isola and Alexei Efros · 2016
Cited alongside, same era.
“Places: An image database for deep scene understanding”
Bolei Zhou et al · 2016
Cited alongside, same era.
“Accurate, large minibatch sgd: Training imagenet in 1 hour”
Priya Goyal et al · 2017
Cited alongside, same era.
“Mask r-cnn”
Kaiming He, Georgia Gkioxari, Piotr Dollár and Ross Girshick · 2017
Cited alongside, same era.
“Regularizing neural networks by penalizing confident output distributions”
Gabriel Pereyra et al · 2017
Cited alongside, same era.
Yonglong Tian, Dilip Krishnan and Phillip Isola · 2020
Later among the works it cites.
“What makes for good views for contrastive learning?”
Yonglong Tian et al · 2020
Later among the works it cites.
“Understanding contrastive representation learning through alignment and uniformity on the hypersphere”
Tongzhou Wang and Phillip Isola · 2020
Later among the works it cites.
“Learning diverse and discriminative representations via the principle of maximal coding rate reduction”
Yaodong Yu et al · 2020
Later among the works it cites.
“Beit: Bert pre-training of image transformers”
Hangbo Bao, Li Dong and Furu Wei · 2021
Later among the works it cites.
“Vicreg: Variance-invariance-covariance regularization for self-supervised learning”
Adrien Bardes, Jean Ponce and Yann LeCun · 2021
Later among the works it cites.
“Emerging properties in self-supervised vision transformers”
Mathilde Caron et al · 2021
Later among the works it cites.
“Exploring simple siamese representation learning”
Xinlei Chen and Kaiming He · 2021
Later among the works it cites.
“An empirical study of training self-supervised vision transformers”
Xinlei Chen, Saining Xie and Kaiming He · 2021
Later among the works it cites.
“With a little help from my friends: Nearest-neighbor contrastive learning of visual representations”
Debidatta Dwibedi et al · 2021
Later among the works it cites.
“Whitening for self-supervised representation learning”
Aleksandr Ermolov, Aliaksandr Siarohin, Enver Sangineto and Nicu Sebe · 2021
Later among the works it cites.
“Unsupervised Pre-training for Person Re-identification”
Dengpan Fu et al · 2021
Later among the works it cites.
“On feature decorrelation in self-supervised learning”
Tianyu Hua et al · 2021
Later among the works it cites.
“Improving Transferability of Representations via Augmentation-Aware Self-Supervision”
Hankook Lee et al · 2021
Later among the works it cites.
“Compressive visual representations”
Kuang-Huei Lee et al · 2021
Later among the works it cites.
“Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework”
Chenxin Tao et al · 2021
Later among the works it cites.
“Self-supervised representation learning with relative predictive coding”
Yao-Hung Tsai et al · 2021
Later among the works it cites.
“Understanding the behaviour of contrastive loss”
Feng Wang and Huaping Liu · 2021
Later among the works it cites.
“Do Different Tracking Tasks Require Different Appearance Models?”
Zhongdao Wang et al · 2021
Later among the works it cites.
“DetCo: Unsupervised Contrastive Learning for Object Detection”
Enze Xie et al · 2021
Later among the works it cites.
“Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning”
Zhenda Xie et al · 2021
Later among the works it cites.
“Barlow twins: Self-supervised learning via redundancy reduction”
Jure Zbontar et al · 2021
Later among the works it cites.
“ibot: Image bert pre-training with online tokenizer”
Jinghao Zhou et al · 2021
Later among the works it cites.
“Masked autoencoders are scalable vision learners”
Kaiming He et al · 2022
Closest in time.