Fetching the paper…
Reading the bibliography…
There is a recently discovered and intriguing phenomenon called Neural Collapse: at the terminal phase of training a deep neural network for classification, the within-class penultimate feature means and the associated classifier vectors of all flat classes collapse to the vertices of a simplex Equiangular Tight Frame (ETF).
Cognitron: A self-organizing multilayered neural network
Kunihiko Fukushima · 1975
Earlier work this paper cites.
Matrix Analysis
Roger A. Horn and Charles R. Johnson · 1990
Earlier work this paper cites.
Jensen-Shannon Divergence and Hilbert Space Embedding
B. Fuglede and F. Topsoe · 2004
Earlier work this paper cites.
Imagenet: A Large-scale Hierarchical Image Database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009
Earlier work this paper cites.
What Does Classifying More Than 10, 000 Image Categories Tell Us?
Jia Deng, Alexander Berg, Kai Li, and Fei-Fei Li · 2010
Earlier work this paper cites.
Hedging your bets: Optimizing accuracy-specificity trade-offs in large scale visual recognition
Jia Deng, J. Krause, A.C. Berg, and Li Fei-Fei · 2012
Earlier work this paper cites.
Learning Multiple Layers of Features from Tiny Images
Alex Krizhevsky · 2012
Earlier work this paper cites.
Introduction to Finite Frame Theory
Peter G. Casazza, Gitta Kutyniok, and Friedrich Philipp · 2013
Earlier work this paper cites.
DeViSE: A Deep Visual-Semantic Embedding Model
Andrea Frome, Greg S Corrado, Jon Shlens, Samy Bengio, Jeff Dean, Marc' Aurelio Ranzato, and Tomas Mikolov · 2013
Earlier work this paper cites.
Fine-Grained Visual Classification of Aircraft
S. Maji, J. Kannala, E. Rahtu, M. Blaschko, and A. Vedaldi · 2013
Earlier work this paper cites.
Zero-Shot Learning by Convex Combination of Semantic Embeddings
Mohammad Norouzi, Tomas Mikolov, Samy Bengio, Yoram Singer, Jonathon Shlens, Andrea Frome, Gregory S. Corrado, and Jeffrey Dean · 2013
Earlier work this paper cites.
Large-Scale Object Classification Using Label Relation Graphs
Jia Deng, Nan Ding, Yangqing Jia, Andrea Frome, Kevin Murphy, Samy Bengio, Yuan Li, Hartmut Neven, and Hartwig Adam · 2014
Earlier work this paper cites.
Deep Residual Learning for Image Recognition
Kaiming He, X. Zhang, Shaoqing Ren, and Jian Sun · 2015
Earlier work this paper cites.
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
Kaiming He, X. Zhang, Shaoqing Ren, and Jian Sun · 2015
Earlier work this paper cites.
Rethinking the Inception Architecture for Computer Vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, and Zbigniew Wojna · 2015
Earlier work this paper cites.
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Djork-Arné Clevert, Thomas Unterthiner, and Sepp Hochreiter · 2016
Earlier work this paper cites.
Gaussian Error Linear Units (GELUs)
Dan Hendrycks and Kevin Gimpel · 2016
Cited alongside, same era.
Learning to Make Better Mistakes: Semantics-Aware Visual Food Recognition
Hui Wu, Michele Merler, Rosario Uceda-Sosa, and John R. Smith · 2016
Cited alongside, same era.
Wide Residual Networks
Sergey Zagoruyko and Nikos Komodakis · 2016
Cited alongside, same era.
Do Convolutional Neural Networks Learn Class Hierarchy?
Bilal Alsallakh, Amin Jourabloo, Mao Ye, Xiaoming Liu, and Liu Ren · 2017
Cited alongside, same era.
Fix Your Classifier: The Marginal Value of Training The Last Weight Layer
Elad Hoffer, Itay Hubara, and Daniel Soudry · 2018
Cited alongside, same era.
The iNaturalist Species Classification and Detection Dataset
Grant Van Horn, Oisin Mac Aodha, Yang Song, Yin Cui, Chen Sun, Alexander Shepard, Hartwig Adam, Pietro Perona, and Serge J. Belongie · 2018
Cited alongside, same era.
Prevalence of Neural Collapse During the Terminal Phase of Deep Learning Training
Vardan Papyan, X.Y. Han, and David Donoho · 2020
Later among the works it cites.
Solving Long-tailed Recognition with Deep Realistic Taxonomic Classifier
Tz-Ying Wu, Pedro Morgado, Pei Wang, Chih-Hui Ho, and Nuno Vasconcelos · 2020
Later among the works it cites.
PASS: An ImageNet Replacement for Self-supervised Pretraining Without Humans
Yuki M. Asano, Christian Rupprecht, Andrew Zisserman, and Andrea Vedaldi · 2021
Later among the works it cites.
Your ”Flamingo” is My ”Bird”: Fine-Grained, or Not
Dongliang Chang, Kaiyue Pang, Yixiao Zheng, Zhanyu Ma, Yi-Zhe Song, and Jun Guo · 2021
Later among the works it cites.
Exploring deep neural networks via layer-peeled model: Minority collapse in imbalanced training
Cong Fang, Hangfeng He, Qi Long, and Weijie J. Su · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Hierarchical Novelty Detection for Visual Object Recognition
Kibok Lee, Kimin Lee, Kyle Min, Yuting Zhang, Jinwoo Shin, and Honglak Lee · 2018
Cited alongside, same era.
Dynamic-structured Semantic Propagation Network
Xiaodan Liang, Hongfei Zhou, and Eric Xing · 2018
Cited alongside, same era.
Meta-Learning for Semi-Supervised Few-Shot Classification
Mengye Ren, Eleni Triantafillou, Sachin Ravi, Jake Snell, Kevin Swersky, Joshua B. Tenenbaum, Hugo Larochelle, and Richard S. Zemel · 2018
Cited alongside, same era.
Hierarchy-Based Image Embeddings for Semantic Image Retrieval
Björn Barz and Joachim Denzler · 2019
Cited alongside, same era.
Integrating Domain Knowledge: Using Hierarchies to Improve Deep Classifiers
Clemens-Alexander Brust and Joachim Denzler · 2019
Cited alongside, same era.
Maximally Compact and Separated Features with Regular Polytope Networks
Federico Pernici, Matteo Bruni, Claudio Baecchi, and Alberto Del Bimbo · 2019
Cited alongside, same era.
Yubin Ge, Site Li, Xuyang Li, Fangfang Fan, Wanqing Xie, Jane Jia You, and Xiaofeng Liu · 2021
Later among the works it cites.
No Cost Likelihood Manipulation at Test Time for Making Better Mistakes in Deep Networks
Shyamgopal Karthik, Ameya Prabhu, Puneet K. Dokania, and Vineet Gandhi · 2021
Later among the works it cites.
Regular Polytope Networks
Federico Pernici, Matteo Bruni, Claudio Baecchi, and A. Bimbo · 2021
Later among the works it cites.
Learning Transferable Visual Models From Natural Language Supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever · 2021
Later among the works it cites.
Connecting Sphere Manifolds Hierarchically for Regularization
Damien Scieur and Youngsung Kim · 2021
Later among the works it cites.
Learning Hierarchy Aware Features for Reducing Mistake Severity
Ashima Garg, Depanshu Sani, and Saket Anand · 2022
Later among the works it cites.
Inducing Neural Collapse in Imbalanced Learning: Do We Really Need a Learnable Classifier at the End of Deep Neural Network?
Yibo Yang, Liang Xie, Shixiang Chen, Xiangtai Li, Zhouchen Lin, and Dacheng Tao · 2022
Later among the works it cites.
Skin lesion recognition with class-hierarchy regularized hyperbolic embeddings
Zhen Yu, Toan Nguyen, Yaniv Gal, Lie Ju, Shekhar S. Chandra, Lei Zhang, Paul Bonnington, Victoria Mar, Zhiyong Wang, and Zongyuan Ge · 2022
Later among the works it cites.
Inducing Neural Collapse in Deep Long-tailed Learning
Xuantong Liu, Jianfeng Zhang, Tianyang Hu, He Cao, Lujia Pan, and Yuan Yao · 2023
Closest in time.
Understanding Imbalanced Semantic Segmentation Through Neural Collapse
Zhisheng Zhong, Jiequan Cui, Yibo Yang, Xiaoyang Wu, Xiaojuan Qi, Xiangyu Zhang, and Jiaya Jia · 2023
Closest in time.