Barcodes as Summary of Loss Function Topology

M. Z. Alom, T. M. Taha, C. Yakopcic, S. Westberg, P. Sidike, M. S. Nasrin, M. Hasan, B. C. Van Essen, A. A. Awwal, V. K. Asari, A state-of-the-art survey on deep learning theory and architectures, Electronics 8 (3) (2019) 292

Original

1912

Earlier work this paper cites.

R. Thom, Sur une partition en cellules associée à une fonction sur une variété, Comptes Rendus de l’Academie des Sciences 228 (12) (1949) 973–975

1949

Earlier work this paper cites.

S. Smale, Differentiable dynamical systems, Bulletin of the American mathematical Society 73 (6) (1967) 747–817

1967

Earlier work this paper cites.

R. Bott, Lectures on Morse theory, old and new, Bulletin of the american mathematical society 7 (2) (1982) 331–358

1982

Earlier work this paper cites.

M. Gori, A. Tesi, On the problem of local minima in backpropagation, IEEE Transactions on Pattern Analysis & Machine Intelligence 14 (1) (1992) 76–86

1992

Earlier work this paper cites.

doi:10.1090/advsov/021/03

S. Barannikov, Framed Morse complexes and its invariants., Advances in Soviet Mathematics 21 (1994) 93–116 · 1994

Earlier work this paper cites.

A. Efrat, A. Itai, M. J. Katz, Geometry helps in bottleneck matching and related problems, Algorithmica 31 (1) (2001) 1–28

2001

Earlier work this paper cites.

doi:10.1002/0471231509.ch1

C. Dellago, P. G. Bolhuis, P. L. Geissler, Transition Path Sampling, John Wiley & Sons, Ltd, 2003, pp. 1–78 · 2003

Earlier work this paper cites.

D. Cohen-Steiner, H. Edelsbrunner, J. Harer, Stability of persistence diagrams, Discrete & Computational Geometry 37 (1) (2007) 103–120

2007

Earlier work this paper cites.

P. B. M. K. Chung, P. T. Kim, Persistence diagrams of cortical surface data, Information Processing in Medical Imaging 5636 (2009) 386–397

2009

Cited alongside, same era.

doi:10.1063/1.3079326

A. R. Oganov, M. Valle, How to quantify energy landscapes of solids, The Journal of Chemical Physics 130 (10) (2009) 104504 · 2009

Cited alongside, same era.

doi:10.1111/j.1365-2966.2011.18395.x

T. Sousbie, C. Pichon, H. Kawahara, The persistent cosmic web and its filamentary structure – II. Illustrations, Monthly Notices of the Royal Astronomical Society 414 (1) (2011) 384–403 · 2011

Cited alongside, same era.

F. Chazal, L. Guibas, S. Oudot, P. Skraba, Scalar field analysis over point cloud data, Discrete & Computational Geometry 46 (4) (2011) 743

2011

Cited alongside, same era.

J. Bergstra, Y. Bengio, Random search for hyper-parameter optimization, Journal of Machine Learning Research 13 (Feb) (2012) 281–305

2012

Cited alongside, same era.

K. Kawaguchi, Deep learning without poor local minima, in: Advances in neural information processing systems, 2016, pp. 586–594

2016

Later among the works it cites.

J. Cao, Q. Wu, Y. Yan, L. Wang, M. Tan, On the flatness of loss surface for two-layered relu networks, in: Asian Conference on Machine Learning, 2017, pp. 545–560

2017

Later among the works it cites.

P. Chaudhari, A. Choromanska, S. Soatto, Y. LeCun, C. Baldassi, C. Borgs, J. Chayes, L. Sagun, R. Zecchina, Entropy-sgd: Biasing gradient descent into wide valleys, in: International Conference on Learning Representations (ICLR), 2017

2017

Later among the works it cites.

L. Dinh, R. Pascanu, S. Bengio, Y. Bengio, Sharp minima can generalize for deep nets, in: Proceedings of the 34th International Conference on Machine Learning, Proceedings of Machine Learning Research, PMLR, 2017, pp. 1019–1028

2017

Later among the works it cites.