GENNI: Visualising the Geometry of Equivalences for Neural Network Identifiability

Uniqueness of the weights for minimal feedforward nets with a given input-output map

Héctor J. Sussmann · 1992

Earlier work this paper cites.

For neural networks, function determines form

Francesca Albertini and Eduardo D Sontag · 1993

Earlier work this paper cites.

Uniqueness of weights for neural networks

Francesca Albertini, Eduardo D Sontag, and Vincent Maillot · 1993

Earlier work this paper cites.

Natural gradient works efficiently in learning

Shun-Ichi Amari · 1998

Earlier work this paper cites.

Gradient-based learning applied to document recognition

Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998

Earlier work this paper cites.

Statistical inference

George Casella and Roger L Berger · 2002

Earlier work this paper cites.

A survey on transfer learning

Sinno Jialin Pan and Qiang Yang · 2009

Earlier work this paper cites.

Imagenet classification with deep convolutional neural networks

Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012

Earlier work this paper cites.

Introduction to Smooth Manifolds

John M Lee · 2013

Cited alongside, same era.

Deep residual learning for image recognition

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016

Cited alongside, same era.

Sharp minima can generalize for deep nets

Original

Laurent Dinh, Razvan Pascanu, Samy Bengio, and Yoshua Bengio · 2017

Cited alongside, same era.

Improving the identifiability of neural networks for bayesian inference

Arya A Pourzanjani, Richard M Jiang, and Linda R Petzold · 2017

Cited alongside, same era.

Empirical analysis of the hessian of over-parametrized neural networks

Original

Levent Sagun, Utku Evci, V Ugur Guney, Yann Dauphin, and Leon Bottou · 2017

Cited alongside, same era.

Bert: Pre-training of deep bidirectional transformers for language understanding

Visualizing the loss landscape of neural nets

Hao Li, Zheng Xu, Gavin Taylor, Christoph Studer, and Tom Goldstein · 2018

Later among the works it cites.

Umap: Uniform manifold approximation and projection for dimension reduction

Original

Leland McInnes, John Healy, and James Melville · 2018

Later among the works it cites.

𝒢 \mathcal{G} -sgd: Optimizing relu neural networks in its positively scale-invariant space

Original

Qi Meng, Shuxin Zheng, Huishuai Zhang, Wei Chen, Zhi-Ming Ma, and Tie-Yan Liu · 2018

Later among the works it cites.

Weight-space symmetry in deep networks gives rise to permutation saddles, connected by equal-loss valleys across the loss landscape

Original

Johanni Brea, Berfin Simsek, Bernd Illing, and Wulfram Gerstner · 2019

Later among the works it cites.

Meta-learning in neural networks: A survey