Fetching the paper…
Reading the bibliography…
When analyzing parametric statistical models, a useful approach consists in modeling geometrically the parameter space.
“Lightlike Neuromanifolds, Occam’s Razor and Deep Learning”, 2021
Ke Sun and Frank Nielsen · 1905
Earlier work this paper cites.
“Spaces of statistical parameters” First mention hyperbolic geometry for Fisher-Rao metric of location-scale family
Harold Hotelling · 1930
Earlier work this paper cites.
“Resolution of Singularities of an Algebraic Variety Over a Field of Characteristic Zero: I”
Heisuke Hironaka · 1964
Earlier work this paper cites.
“Resolution of Singularities of an Algebraic Variety Over a Field of Characteristic Zero: II”
Heisuke Hironaka · 1964
Earlier work this paper cites.
“A new look at the statistical model identification”
Hirotugu Akaike · 1974
Earlier work this paper cites.
“Estimating the dimension of a model”
Gideon Schwarz · 1978
Earlier work this paper cites.
“Finsler geometry of non-regular statistical models”
Shun-ichi Amari · 1984
Earlier work this paper cites.
“On the concept of attractor”
John Milnor · 1985
Earlier work this paper cites.
“Geometrical Singularities in the Neuromanifold of Multilayer Perceptrons”
Shun-ichi Amari, Hyeyoung Park and Tomoko Ozeki · 2001
Earlier work this paper cites.
“Resolution of Stratifolds and Connection to Mather’s Abstract Pre-Stratified Spaces”, 2003
Anna Grinberg · 2003
Cited alongside, same era.
“Singularities Affect Dynamics of Learning in Neuromanifolds”
Shun-ichi Amari, Hyeyoung Park and Tomoko Ozeki · 2006
Cited alongside, same era.
“Dynamics of learning near singularities in layered networks”
Haikun Wei, Jun Zhang, Florent Cousseau, Tomoko Ozeki and Shun-ichi Amari · 2008
Cited alongside, same era.
“Algebraic Geometry and Statistical Learning Theory”, Cambridge Monographs on Applied and Computational Mathematics, 2009
Sumio Watanabe · 2009
Cited alongside, same era.
“Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory”
Sumio Watanabe · 2010
Cited alongside, same era.
“A Widely Applicable Bayesian Information Criterion”
Sumio Watanabe · 2013
Later among the works it cites.
“Adam: A Method for Stochastic Optimization”
Diederik Kingma and Jimmy Ba · 2014
Later among the works it cites.
“Efficient approaches for escaping higher order saddle points in non-convex optimization”
Anima Anandkumar and Rong Ge · 2016
Later among the works it cites.
“On the category of stratifolds”
Toshiki Aoki and Katsuhiko Kuribayashi · 2016
Later among the works it cites.
“Dynamics of Learning in MLP: Natural Gradient and Singularity Revisited”
Shun-ichi Amari, Tomoko Ozeki, Ryo Karakida, Yuki Yoshida and Masato Okada · 2018
Later among the works it cites.
“Averaging stochastic gradient descent on Riemannian manifolds”
Nilesh Tripuraneni, Nicolas Flammarion, Francis Bach and Michael Jordan · 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
John Duchi, Elad Hazan and Yoram Singer · 2011
Cited alongside, same era.
“Differential Algebraic Topology: From Stratifolds to Exotic Spheres”
Matthias Kreck · 2012
Cited alongside, same era.
“Lecture 6.5—RmsProp: Divide the gradient by a running average of its recent magnitude”, COURSERA: Neural Networks for Machine Learning, 2012
T. Tieleman and G. Hinton · 2012
Cited alongside, same era.
“Stochastic Gradient Descent on Riemannian Manifolds”
Silv“‘ere Bonnabel · 2013
Cited alongside, same era.
Later among the works it cites.
“The Topological Correctness of PL-Approximations of Isomanifolds”
Jean-Daniel Boissonnat and Mathijs Wintraecken · 2020
Later among the works it cites.
“New insights and perspectives on the natural gradient method”
James Martens · 2020
Later among the works it cites.
“Tractable structured natural-gradient descent using local parameterizations”
Wu Lin, Frank Nielsen, Mohammad Khan and Mark Schmidt · 2021
Closest in time.