Fetching the paper…
Reading the bibliography…
Numerically locating the critical points of non-convex surfaces is a long-standing problem central to many fields.
A method for the solution of certain non-linear problems in least squares
Levenberg, K · 1944
Earlier work this paper cites.
On a new method of numerical solution of systems of nonlinear equations
Davidenko, D. F · 1953
Earlier work this paper cites.
A new method of solving nonlinear simultaneous equations
Broyden, C. G · 1969
Earlier work this paper cites.
Convergence conditions for ascent methods. II: Some corrections
Wolfe, P · 1971
Earlier work this paper cites.
Structure of transition states in organic reactions. general theory and an application to the cyclobutene-butadiene isomerization using a semiempirical molecular orbital method
McIver, J. W. and Komornicki, A · 1972
Earlier work this paper cites.
Analysis of Newton’s method at irregular singularities
Griewank, A. and Osborne, M. R · 1983
Earlier work this paper cites.
Computation and multiplicity of economic equilibria
Kehoe, T. J · 1987
Earlier work this paper cites.
Neural networks and principal component analysis: Learning from examples without local minima
Baldi, P. and Hornik, K · 1989
Earlier work this paper cites.
On the limited memory BFGS method for large scale optimization
Liu, D. C. and Nocedal, J · 1989
Earlier work this paper cites.
Fast exact multiplication by the Hessian
Pearlmutter, B. A · 1994
Earlier work this paper cites.
Exponentially many local minima for single neurons
Auer, P., Herbster, M., and Warmuth, M. K · 1996
Earlier work this paper cites.
488 solutions to the XOR problem
Coetzee, F. and Stonick, V. L · 1997
Earlier work this paper cites.
Flat minima
Hochreiter, S. and Schmidhuber, J · 1997
Earlier work this paper cites.
Saddles in the energy landscape probed by supercooled liquids
Angelani, L., Leonardo, R. D., Ruocco, G., Scala, A., and Sciortino, F · 2000
Earlier work this paper cites.
Energy landscape of a Lennard-Jones liquid: statistics of stationary points
Broderix, K., Bhattacharya, K. K., Cavagna, A., Zippelius, A., and Giardina, I · 2000
Earlier work this paper cites.
Saddle points and dynamics of Lennard-Jones clusters, solids, and supercooled liquids
Doye, J. P. K. and Wales, D. J · 2002
Earlier work this paper cites.
Convex Optimization
Boyd, S. and Vandenberghe, L · 2004
Cited alongside, same era.
A doubly nudged elastic band method for finding transition states
Trygubenko, S. A. and Wales, D. J · 2004
Cited alongside, same era.
Energy Landscapes: Applications to Clusters, Biomolecules and Glasses
Wales, D · 2004
Cited alongside, same era.
Introduction to numerical algebraic geometry
Sommese, A. J., Verschelde, J., and Wampler, C. W · 2005
Cited alongside, same era.
MINRES-QLP: A Krylov subspace method for indefinite or singular symmetric systems
Choi, S.-C. T., Paige, C. C., and Saunders, M. A · 2011
Cited alongside, same era.
Numerically Solving Polynomial Systems with Bertini (Software, Environments and Tools)
Bates, D. J., Haunstein, J. D., Sommese, A. J., and Wampler, C. W · 2013
Cited alongside, same era.
Gradient descent only converges to minimizers
Lee, J. D., Simchowitz, M., Jordan, M. I., and Recht, B · 2016
Later among the works it cites.
Modeling, Inference and Optimization with Composable Differentiable Procedures
Maclaurin, D · 2016
Later among the works it cites.
High-dimensional dynamics of generalization error in neural networks
Advani, M. S. and Saxe, A. M · 2017
Later among the works it cites.
Energy landscapes for machine learning
Ballard, A. J., Das, R., Martiniani, S., Mehta, D., Sagun, L., Stevenson, J. D., and Wales, D. J · 2017
Later among the works it cites.
Sharp minima can generalize for deep nets
Dinh, L., Pascanu, R., Bengio, S., and Bengio, Y · 2017
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks
Saxe, A. M., McClelland, J. L., and Ganguli, S · 2013
Cited alongside, same era.
The loss surface of multilayer networks
Choromanska, A., Henaff, M., Mathieu, M., Arous, G. B., and LeCun, Y · 2014
Cited alongside, same era.
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization
Dauphin, Y., Pascanu, R., Gülçehre, Ç., Cho, K., Ganguli, S., and Bengio, Y · 2014
Cited alongside, same era.
Newton-Type Methods for Optimization and Variational Problems
Izmailov, A. F. and Solodov, M. V · 2014
Cited alongside, same era.
On the saddle point problem for non-convex optimization
Pascanu, R., Dauphin, Y. N., Ganguli, S., and Bengio, Y · 2014
Cited alongside, same era.
Deep learning in neural networks: An overview
Schmidhuber, J · 2014
Cited alongside, same era.
Jin, C., Ge, R., Netrapalli, P., Kakade, S. M., and Jordan, M. I · 2017
Later among the works it cites.
Deep linear neural networks with arbitrary loss: all local minima are global
Laurent, T. and von Brecht, J · 2017
Later among the works it cites.
Geometry of neural network loss surfaces via random matrix theory
Pennington, J. and Bahri, Y · 2017
Later among the works it cites.
Empirical analysis of the Hessian of over-parametrized neural networks
Sagun, L., Evci, U., Güney, V. U., Dauphin, Y., and Bottou, L · 2017
Later among the works it cites.
Critical points of neural networks: analytical forms and landscape properties
Zhou, Y. and Liang, Y · 2017
Later among the works it cites.
Regularisation of neural networks by enforcing Lipschitz continuity
Gouk, H., Frank, E., Pfahringer, B., and Cree, M · 2018
Later among the works it cites.
Minimizing nonconvex population risk from rough empirical risk
Jin, C., Liu, L. T., Ge, R., and Jordan, M. I · 2018
Later among the works it cites.
Understanding the loss surface of neural networks for binary classification
Liang, S., Sun, R., Li, Y., and Srikant, R · 2018
Later among the works it cites.
Newton-MR: Newton’s method without smoothness or convexity
Roosta, F., Liu, Y., Xu, P., and Mahoney, M. W · 2018
Later among the works it cites.
Hessian-based analysis of large batch training and robustness to adversaries
Yao, Z., Gholami, A., Lei, Q., Keutzer, K., and Mahoney, M. W · 2018
Later among the works it cites.