Fetching the paper…
Reading the bibliography…
In contemporary self-supervised contrastive algorithms like SimCLR, MoCo, etc., the task of balancing attraction between two semantically similar samples and repulsion between two samples of different classes is primarily affected by the presence of hard negative samples.
2003
Earlier work this paper cites.
Nilsback, M.E., Zisserman, A.: A visual vocabulary for flower classification. In: IEEE Conference on Computer Vision and Pattern Recognition. vol. 2, pp. 1447–1454 (2006)
2006
Earlier work this paper cites.
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: A large-scale hierarchical image database. In: CVPR (2009)
2009
Earlier work this paper cites.
Krizhevsky, A.: Learning multiple layers of features from tiny images (2009), https://www.cs.toronto.edu/~kriz/learning-features-2009-TR.pdf
2009
Earlier work this paper cites.
Gutmann, M., Hyvärinen, A.: Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In: AISTATS (2010)
2010
Earlier work this paper cites.
Kingma, D.P., Welling, M.: Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013)
2013
Earlier work this paper cites.
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial networks (2014)
2014
Earlier work this paper cites.
He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: ICCV (2015)
2015
Earlier work this paper cites.
Ioffe, S., Szegedy, C.: Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: ICML (2015)
2015
Earlier work this paper cites.
Bautista, M.A., Sanakoyeu, A., Tikhoncheva, E., Ommer, B.: Cliquecnn: Deep unsupervised exemplar learning. In: NeurIPS (2016)
2016
Earlier work this paper cites.
2016
Earlier work this paper cites.
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR (2016)
2016
Earlier work this paper cites.
Noroozi, M., Favaro, P.: Unsupervised learning of visual representations by solving jigsaw puzzles. In: ECCV (2016)
2016
Earlier work this paper cites.
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., Efros, A.A.: Context encoders: Feature learning by inpainting. In: CVPR (2016)
2016
Earlier work this paper cites.
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., Efros, A.A.: Context encoders: Feature learning by inpainting. In: CVPR (2016)
2016
Earlier work this paper cites.
for Digital Imaging of the Skin (ISDIS), I.S.: https://challenge.isic-archive.com/leaderboards/2016/, https://challenge.isic-archive.com/leaderboards/2016/
2016
Earlier work this paper cites.
Zhang, R., Isola, P., Efros, A.A.: Colorful image colorization. In: ECCV (2016)
2016
Earlier work this paper cites.
Ledig, C., Theis, L., Huszár, F., Caballero, J., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: CVPR (2017)
2017
Earlier work this paper cites.
2017
Earlier work this paper cites.
Caron, M., Bojanowski, P., Joulin, A., Douze, M.: Deep clustering for unsupervised learning of visual features. In: ECCV (2018)
2018
Cited alongside, same era.
2018
Cited alongside, same era.
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. In: North American Chapter of the Association for Computational Linguistics (2019), https://api.semanticscholar.org/CorpusID:52967399
2019
Cited alongside, same era.
Huang, J., Dong, Q., Gong, S., Zhu, X.: Unsupervised deep learning by neighbourhood discovery. In: ICML (2019)
2019
Cited alongside, same era.
Wang, F., Liu, H.: Understanding the behaviour of contrastive loss. In: CVPR (2021)
2021
Later among the works it cites.
Wang, F., Liu, H.: Understanding the behaviour of contrastive loss. In: CVPR (2021)
2021
Later among the works it cites.
Wei, J.W., Suriawinata, A.A., Ren, B., Liu, X., Lisovsky, M., Vaickus, L.J., Brown, C., Baker, M., Tomita, N., Torresani, L., Wei, J., Hassanpour, S.: A petri dish for histopathology image analysis. In: Tucker, A., Abreu, P.H., Cardoso, J.S., Rodrigues, P.P., Riaño, D. (eds.) Artificial Intelligence in Medicine - 19th International Conference on Artificial Intelligence in Medicine, AIME 2021, Virtual Event, June 15-18, 2021, Proceedings. Lecture Notes in Computer Science, vol. 12721, pp. 11–24. Springer (2021). https://doi.org/10.1007/978-3-030-77211-6_2, https://doi.org/10.1007/978-3-030-77211-6_2
2021
Later among the works it cites.
Zbontar, J., Jing, L., Misra, I., LeCun, Y., Deny, S.: Barlow twins: Self-supervised learning via redundancy reduction. In: International Conference on Machine Learning. pp. 12310–12320. PMLR (2021)
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2020
Cited alongside, same era.
Chen, T., Kornblith, S., Norouzi, M., Hinton, G.E.: A simple framework for contrastive learning of visual representations. In: ICML (2020)
2020
Cited alongside, same era.
Chen, T., Kornblith, S., Swersky, K., Norouzi, M., Hinton, G.E.: Big self-supervised models are strong semi-supervised learners. In: NeurIPS (2020)
2020
Cited alongside, same era.
Grill, J.B., Strub, F., Altché, F., Tallec, C., et al.: Bootstrap your own latent - a new approach to self-supervised learning. In: NeurIPS (2020)
2020
Cited alongside, same era.
He, K., Fan, H., Wu, Y., Xie, S., Girshick, R.B.: Momentum contrast for unsupervised visual representation learning. In: CVPR (2020)
2020
Cited alongside, same era.
Jing, L., Tian, Y.: Self-supervised visual feature learning with deep neural networks: A survey. IEEE TPAMI (2020)
2020
Cited alongside, same era.
Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., Krishnan, D.: Supervised contrastive learning. In: NeurIPS (2020)
2020
Cited alongside, same era.
Susmelj, I., Helle, M., Wirth, P., Prescott, J., et al., M.E.: Lightly (2020)
2020
Cited alongside, same era.
2021
Later among the works it cites.
2021
Later among the works it cites.
Zhu, C., Chen, W., Peng, T., Wang, Y., Jin, M.: Hard sample aware noise robust learning for histopathology image classification. IEEE Trans. Medical Imaging 41
2021
Later among the works it cites.
Bardes, A., Ponce, J., LeCun, Y.: Vicreg: Variance-invariance-covariance regularization for self-supervised learning. In: The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net (2022), https://openreview.net/forum?id=xm6YD62D1Ub
2022
Later among the works it cites.
Yeh, C.H., Hong, C.Y., Hsu, Y.C., Liu, T.L., Chen, Y., LeCun, Y.: Decoupled contrastive learning. In: Computer Vision – ECCV 2022. pp. 668–684. Springer Nature Switzerland, Cham (2022)
2022
Later among the works it cites.
Zhang, S., Qiu, L., Zhu, F., Yan, J., Zhang, H., Zhao, R., Li, H., Yang, X.: Align representations with base: A new approach to self-supervised learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, June 18-24, 2022. pp. 16579–16588. IEEE (2022). https://doi.org/10.1109/CVPR52688.2022.01610, https://doi.org/10.1109/CVPR52688.2022.01610
2022
Later among the works it cites.
Zhang, S., Zhu, F., Yan, J., Zhao, R., Yang, X.: Zero-cl: Instance and feature decorrelation for negative-free symmetric contrastive learning. In: The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net (2022), https://openreview.net/forum?id=RAW9tCdVxLj
2022
Later among the works it cites.
Zhou, J., Wei, C., Wang, H., Shen, W., Xie, C., Yuille, A., Kong, T.: ibot: Image bert pre-training with online tokenizer. International Conference on Learning Representations (ICLR) (2022)
2022
Later among the works it cites.
Galdran, A., Verjans, J.W., Carneiro, G., González Ballester, M.A.: Multi-head multi-loss model calibration. In: Greenspan, H., Madabhushi, A., Mousavi, P., Salcudean, S., Duncan, J., Syeda-Mahmood, T., Taylor, R. (eds.) Medical Image Computing and Computer Assisted Intervention – MICCAI 2023. pp. 108–117. Springer Nature Switzerland, Cham (2023)
2023
Closest in time.
Kukleva, A., Böhle, M., Schiele, B., Kuehne, H., Rupprecht, C.: Temperature schedules for self-supervised contrastive methods on long-tail data. In: The Eleventh International Conference on Learning Representations (2023), https://openreview.net/forum?id=ejHUr4nfHhD
2023
Closest in time.
Nauta, M., Hegeman, J.H., Geerdink, J., Schlötterer, J., van Keulen, M., Seifert, C.: Interpreting and correcting medical image classification with pip-net (2023)
2023
Closest in time.
Nauta, M., Schlötterer, J., van Keulen, M., Seifert, C.: Pip-net: Patch-based intuitive prototypes for interpretable image classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). pp. 2744–2753 (June 2023)
2023
Closest in time.
Qiu, Z., Hu, Q., Yuan, Z., Zhou, D., Zhang, L., Yang, T.: Not all semantics are created equal: Contrastive self-supervised learning with automatic temperature individualization. In: Krause, A., Brunskill, E., Cho, K., Engelhardt, B., Sabato, S., Scarlett, J. (eds.) International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA. Proceedings of Machine Learning Research, vol. 202, pp. 28389–28421. PMLR (2023), https://proceedings.mlr.press/v202/qiu23a.html
2023
Closest in time.
Springenberg, M., Frommholz, A., Wenzel, M., Weicken, E., Ma, J., Strodthoff, N.: From modern cnns to vision transformers: Assessing the performance, robustness, and classification strategies of deep learning models in histopathology. Medical Image Analysis 87
2023
Closest in time.
Zizheng, H., Haoxing, C., Ziqi, W., Chao, Z., Huaxiong, L., Bo, W., Chunlin, C.: Model-aware contrastive learning: Towards escaping the dilemmas. In: ICML (2023)
2023
Closest in time.