Implicit Regularization in Matrix Factorization

SciPy: Open source scientific tools for Python, 2001

Eric Jones, Travis Oliphant, Pearu Peterson, et al · 2001

Earlier work this paper cites.

A nonlinear programming algorithm for solving semidefinite programs via low-rank factorization

Samuel Burer and Renato DC Monteiro · 2003

Earlier work this paper cites.

Rank, trace-norm and max-norm

Nathan Srebro and Adi Shraibman · 2005

Earlier work this paper cites.

Generalization error bounds for collaborative prediction with low-rank matrices

Nathan Srebro, Noga Alon, and Tommi S Jaakkola · 2005

Earlier work this paper cites.

Uncovering shared structures in multiclass classification

Yonatan Amit, Michael Fink, Nathan Srebro, and Shimon Ullman · 2007

Earlier work this paper cites.

Multi-task feature learning

Andreas Argyriou, Theodoros Evgeniou, and Massimiliano Pontil · 2007

Earlier work this paper cites.

Exact matrix completion via convex optimization

Emmanuel J Candès and Benjamin Recht · 2009

Cited alongside, same era.

Low-rank optimization on the cone of positive semidefinite matrices

Michel Journée, Francis Bach, P-A Absil, and Rodolphe Sepulchre · 2010

Cited alongside, same era.

Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization

Benjamin Recht, Maryam Fazel, and Pablo A Parrilo · 2010

Cited alongside, same era.

Concentration-based guarantees for low-rank matrix reconstruction

Rina Foygel and Nathan Srebro · 2011

Cited alongside, same era.

Efficient algorithms for collaborative filtering

Raghunandan Hulikal Keshavan · 2012

Cited alongside, same era.

In search of the real inductive bias: On the role of implicit regularization in deep learning

Behnam Neyshabur, Ryota Tomioka, and Nathan Srebro · 2015

Global optimality of local search for low rank matrix recovery

Srinadh Bhojanapalli, Behnam Neyshabur, and Nathan Srebro · 2016

Later among the works it cites.

Matrix completion has no spurious local minimum

Rong Ge, Jason D Lee, and Tengyu Ma · 2016

Later among the works it cites.

Gradient descent only converges to minimizers

Jason D. Lee, Max Simchowitz, Michael I. Jordan, and Benjamin Recht · 2016

Later among the works it cites.

On large-batch training for deep learning: Generalization gap and sharp minima

Nitish Shirish Keskar, Dheevatsa Mudigere, Jorge Nocedal, Mikhail Smelyanskiy, and Ping Tak Peter Tang · 2017

Closest in time.

Geometry of optimization and implicit regularization in deep learning

Original

Behnam Neyshabur, Ryota Tomioka, Ruslan Salakhutdinov, and Nathan Srebro · 2017

Closest in time.

Understanding deep learning requires rethinking generalization