Quantitative Convergences of Lie Group Momentum Optimizers

Non-existence of continuous convex functions on certain riemannian manifolds

Shing-Tung Yau · 1974

Earlier work this paper cites.

Curvatures of left invariant metrics on lie groups, 1976

John Milnor · 1976

Earlier work this paper cites.

Introduction to optimization

Boris T Polyak · 1987

Earlier work this paper cites.

Least squares matching problems

Roger W Brockett · 1989

Earlier work this paper cites.

Calculation of the coefficients in the campbell–hausdorff formula

EB Dynkin · 2000

Earlier work this paper cites.

Geometric numerical integration

Ernst Hairer, Marlis Hochbruck, Arieh Iserles, and Christian Lubich · 2006

Earlier work this paper cites.

Uniform sampling methods for various compact spaces

Sean O’Hagan · 2007

Earlier work this paper cites.

Stochastic gradient descent on riemannian manifolds

Silvere Bonnabel · 2013

Earlier work this paper cites.

Introductory lectures on convex optimization: A basic course , volume 87

Yurii Nesterov · 2013

Earlier work this paper cites.

A feasible method for optimization with orthogonality constraints

Zaiwen Wen and Wotao Yin · 2013

Cited alongside, same era.

Unitary evolution recurrent neural networks

Martin Arjovsky, Amar Shah, and Yoshua Bengio · 2016

Cited alongside, same era.

A variational perspective on accelerated methods in optimization

Andre Wibisono, Ashia C Wilson, and Michael I Jordan · 2016

Cited alongside, same era.

First-order methods for geodesically convex optimization

Hongyi Zhang and Suvrit Sra · 2016

Cited alongside, same era.

Parseval networks: Improving robustness to adversarial examples

Moustapha Cisse, Piotr Bojanowski, Edouard Grave, Yann Dauphin, and Nicolas Usunier · 2017

Cited alongside, same era.

Orthogonal recurrent neural networks with scaled cayley transform

Kyle Helfrich, Devin Willmott, and Qiang Ye · 2018

Cited alongside, same era.

From nesterov’s estimate sequence to riemannian acceleration

Kwangjun Ahn and Suvrit Sra · 2020

Later among the works it cites.

A continuous-time perspective for modeling acceleration in riemannian optimization

Foivos Alimisis, Antonio Orvieto, Gary Bécigneul, and Aurelien Lucchi · 2020

Later among the works it cites.

Variational optimization on lie groups, with examples of leading (generalized) eigenvalue problems

Molei Tao and Tomoki Ohsawa · 2020

Later among the works it cites.

Momentum improves optimization on riemannian manifolds

Foivos Alimisis, Antonio Orvieto, Gary Becigneul, and Aurelien Lucchi · 2021

Later among the works it cites.

A reduced parallel transport equation on lie groups with a left-invariant metric

Nicolas Guigui and Xavier Pennec · 2021

Later among the works it cites.

Understanding the acceleration phenomenon via high-resolution differential equations