Fetching the paper…
Reading the bibliography…
While second order optimizers such as natural gradient descent (NGD) often speed up optimization, their effect on generalization has been called into question.
Per-Åke Wedin,
1973
Earlier work this paper cites.
Shun-ichi Amari,
1997
Earlier work this paper cites.
Shun-Ichi Amari,
1998
Earlier work this paper cites.
Shun-Ichi Amari, Hyeyoung Park, and Kenji Fukumizu,
2000
Earlier work this paper cites.
Felipe Cucker and Steve Smale,
2002
Earlier work this paper cites.
Stephen Boyd, Stephen P Boyd, and Lieven Vandenberghe,
2004
Earlier work this paper cites.
Cristian Buciluǎ, Rich Caruana, and Alexandru Niculescu-Mizil,
2006
Earlier work this paper cites.
Jorge Nocedal and Stephen Wright,
2006
Earlier work this paper cites.
Andrea Caponnetto and Ernesto De Vito,
2007
Earlier work this paper cites.
Zhi-Dong Bai and Yong-Qua Yin,
2008
Earlier work this paper cites.
Ingo Steinwart, Don R Hush, and Clint Scovel,
2009
Earlier work this paper cites.
James Martens,
2010
Earlier work this paper cites.
Vinod Nair and Geoffrey E Hinton,
2010
Earlier work this paper cites.
John Duchi, Elad Hazan, and Yoram Singer,
2011
Earlier work this paper cites.
Olivier Ledoit and Sandrine Péché,
2011
Earlier work this paper cites.
Francisco Rubio and Xavier Mestre,
2011
Earlier work this paper cites.
Yann A LeCun, Léon Bottou, Genevieve B Orr, and Klaus-Robert Müller,
2012
Earlier work this paper cites.
James Martens and Ilya Sutskever,
2012
Earlier work this paper cites.
Guillaume Desjardins, Razvan Pascanu, Aaron Courville, and Yoshua Bengio,
2013
Earlier work this paper cites.
2013
Earlier work this paper cites.
Razvan Pascanu and Yoshua Bengio,
2013
Earlier work this paper cites.
Andrew M Saxe, James L McClelland, and Surya Ganguli,
2013
Earlier work this paper cites.
Jimmy Ba and Rich Caruana,
2014
Earlier work this paper cites.
Diederik P Kingma and Jimmy Ba,
2014
Earlier work this paper cites.
Geoffrey Hinton, Oriol Vinyals, and Jeff Dean,
2015
Earlier work this paper cites.
James Martens and Roger Grosse,
2015
Earlier work this paper cites.
Yann Ollivier,
2015
Earlier work this paper cites.
Roger Grosse and James Martens,
2016
Earlier work this paper cites.
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun,
2016
Earlier work this paper cites.
2016
Earlier work this paper cites.
Gaétan Marceau-Caron and Yann Ollivier,
2016
Earlier work this paper cites.
Bo Xie, Yingyu Liang, and Le Song,
2016
Earlier work this paper cites.
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals,
2016
Earlier work this paper cites.
Madhu S Advani and Andrew M Saxe,
2017
Earlier work this paper cites.
Laurent Dinh, Razvan Pascanu, Samy Bengio, and Yoshua Bengio,
2017
Earlier work this paper cites.
Suriya Gunasekar, Blake E Woodworth, Srinadh Bhojanapalli, Behnam Neyshabur, and Nati Srebro,
2017
Earlier work this paper cites.
Nitish Shirish Keskar and Richard Socher,
2017
Cited alongside, same era.
Yuanzhi Li, Tengyu Ma, and Hongyang Zhang,
2017
Cited alongside, same era.
Junhong Lin and Lorenzo Rosasco,
2017
Cited alongside, same era.
Stanislav Minsker,
2017
Cited alongside, same era.
Alessandro Rudi, Luigi Carratino, and Lorenzo Rosasco,
2017
Cited alongside, same era.
Alessandro Rudi and Lorenzo Rosasco,
2017
Cited alongside, same era.
Behrooz Ghorbani, Song Mei, Theodor Misiakiewicz, and Andrea Montanari,
2019
Later among the works it cites.
Trevor Hastie, Andrea Montanari, Saharon Rosset, and Ryan J Tibshirani,
2019
Later among the works it cites.
Frederik Kunstner, Lukas Balles, and Philipp Hennig,
2019
Later among the works it cites.
Daniel Levy and John C Duchi,
2019
Later among the works it cites.
2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2017
Cited alongside, same era.
Naman Agarwal, Brian Bullins, Xinyi Chen, Elad Hazan, Karan Singh, Cyril Zhang, and Yi Zhang,
2018
Cited alongside, same era.
Navid Azizan and Babak Hassibi,
2018
Cited alongside, same era.
Mikhail Belkin, Daniel J Hsu, and Partha Mitra,
2018
Cited alongside, same era.
Mikhail Belkin, Daniel Hsu, Siyuan Ma, and Soumik Mandal,
2018
Cited alongside, same era.
Mikhail Belkin, Alexander Rakhlin, and Alexandre B Tsybakov,
2018
Cited alongside, same era.
2019
Later among the works it cites.
Yuanzhi Li, Colin Wei, and Tengyu Ma,
2019
Later among the works it cites.
Song Mei and Andrea Montanari,
2019
Later among the works it cites.
Andrea Montanari, Feng Ruan, Youngtak Sohn, and Jun Yan,
2019
Later among the works it cites.
Preetum Nakkiran, Gal Kaplun, Yamini Bansal, Tristan Yang, Boaz Barak, and Ilya Sutskever,
2019
Later among the works it cites.
Qian Qian and Xiaoyuan Qian,
2019
Later among the works it cites.
Lili Su and Pengkun Yang,
2019
Later among the works it cites.
Francis Williams, Matthew Trager, Claudio Silva, Daniele Panozzo, Denis Zorin, and Joan Bruna,
2019
Later among the works it cites.
Ji Xu and Daniel J Hsu,
2019
Later among the works it cites.
Guodong Zhang, Lala Li, Zachary Nado, James Martens, Sushant Sachdeva, George Dahl, Chris Shallue, and Roger B Grosse,
2019
Later among the works it cites.
Guodong Zhang, James Martens, and Roger B Grosse,
2019
Later among the works it cites.
Jimmy Ba, Murat A. Erdogdu, Taiji Suzuki, Denny Wu, and Tianzong Zhang,
2020
Closest in time.
2020
Closest in time.
Lenaic Chizat and Francis Bach,
2020
Closest in time.
Federica Gerace, Bruno Loureiro, Florent Krzakala, Marc Mézard, and Lenka Zdeborová,
2020
Closest in time.
2020
Closest in time.
Takashi Ishida, Ikko Yamane, Tomoya Sakai, Gang Niu, and Masashi Sugiyama,
2020
Closest in time.
Ryo Karakida and Kazuki Osawa,
2020
Closest in time.
Aitor Lewkowycz and Guy Gur-Ari,
2020
Closest in time.
Tomoya Murata and Taiji Suzuki,
2020
Closest in time.
2020
Closest in time.
Dominic Richards, Jaouad Mourtada, and Lorenzo Rosasco,
2020
Closest in time.
Taiji Suzuki and Shunta Akiyama,
2020
Closest in time.
Valentin Thomas, Fabian Pedregosa, Bart Merriënboer, Pierre-Antoine Manzagol, Yoshua Bengio, and Nicolas Le Roux,
2020
Closest in time.
Hossein Taheri, Ramtin Pedarsani, and Christos Thrampoulidis,
2020
Closest in time.
2020
Closest in time.
Neha S Wadia, Daniel Duckworth, Samuel S Schoenholz, Ethan Dyer, and Jascha Sohl-Dickstein,
2020
Closest in time.
2020
Closest in time.
2020
Closest in time.
Peng Xu, Fred Roosta, and Michael W Mahoney,
2020
Closest in time.
2020
Closest in time.