Imposing Hard Constraints on Deep Networks: Promises and Limitations

On the numerical solution of the equation by which in technical questions frequencies of small oscillations of material systems are determined

A. N. Krylov · 1931

Earlier work this paper cites.

Solution of sparse indefinite systems of linear equations

C. C. Paige and M. A. Saunders · 1975

Earlier work this paper cites.

Practical Optimization

P. Gill, W. Murray, and M. Wright · 1981

Earlier work this paper cites.

GMRES: A generalized minimal residual algorithm for solving nonsymmetric linear systems

Y. Saad and M. H. Schultz · 1986

Earlier work this paper cites.

Practical Methods of Optimization

R. Fletcher · 1987

Earlier work this paper cites.

Constrained differential optimization

J. C. Platt and A. H. Barr · 1988

Earlier work this paper cites.

Lagrange programming neural networks

S. Zhang and A. Constantinides · 1992

Earlier work this paper cites.

Fast exact multiplication by the Hessian

B. A. Pearlmutter · 1994

Earlier work this paper cites.

Theano: a CPU and GPU math expression compiler

J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio · 2010

Cited alongside, same era.

Adaptive subgradient methods for online learning and stochastic optimization

J. Duchi, E. Hazan, and Y. Singer · 2010

Cited alongside, same era.

Least-Squares Minimization Under Constraints

P. Fua, V. Aydin, R. Urtasun, and M. Salzmann · 2010

Cited alongside, same era.

Implicitly Constrained Gaussian Process Regression for Monocular Non-Rigid Pose Estimation

M. Salzmann and R. Urtasun · 2010

Cited alongside, same era.

Latent structured models for human pose estimation

C. S. Catalin Ionescu, Fuxin Li · 2011

Cited alongside, same era.

MINRES-QLP: A Krylov subspace method for indefinite or singular symmetric systems

S.-C. T. Choi, C. C. Paige, and M. A. Saunders · 2011

Krylov subspace descent for deep learning

O. Vinyals and D. Povey · 2012

Later among the works it cites.

Adadelta: An adaptive learning rate method

M. D. Zeiler · 2012

Later among the works it cites.

Theano optimize

R. Pascanu · 2013

Later among the works it cites.

Human3.6m: Large scale datasets and predictive methods for 3d human sensing in natural environments

C. Ionescu, D. Papava, V. Olaru, and C. Sminchisescu · 2014

Later among the works it cites.

Adam: A method for stochastic optimization

D. P. Kingma and J. Ba · 2014

Later among the works it cites.

Constrained convolutional neural networks for weakly supervised segmentation

D. Pathak, P. Krähenbühl, and T. Darrell · 2015

Later among the works it cites.