Solving differential equations with unknown constitutive relations as recurrent neural networks

Neural algorithm for solving differential equations

Hyuk Lee and In Seok Kang · 1990

Earlier work this paper cites.

Approximation capabilities of multilayer feedforward networks

Kurt Hornik · 1991

Earlier work this paper cites.

A hybrid neural network-first principles approach to process modeling

Dimitris C. Psichogios and Lyle H. Ungar · 1992

Earlier work this paper cites.

Gradient flow in recurrent nets: the difficulty of learning long-term dependencies, 2001

Sepp Hochreiter, Yoshua Bengio, Paolo Frasconi, and Jürgen Schmidhuber · 2001

Earlier work this paper cites.

Understanding the difficulty of training deep feedforward neural networks

Xavier Glorot and Yoshua Bengio · 2010

Cited alongside, same era.

Rectified linear units improve restricted Boltzmann machines

Vinod Nair and Geoffrey E. Hinton · 2010

Cited alongside, same era.

Deep sparse rectifier neural networks

Xavier Glorot, Antoine Bordes, and Yoshua Bengio · 2011

Cited alongside, same era.

Early Stopping — But When?

Lutz Prechelt · 2012

Cited alongside, same era.

Adam: A method for stochastic optimization

Original

Diederik P. Kingma and Jimmy Ba · 2014

Later among the works it cites.

TensorFlow: Large-scale machine learning on heterogeneous systems, 2015

Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Mané, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viégas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng · 2015

Later among the works it cites.

Full-capacity unitary recurrent neural networks

S. Wisdom, T. Powers, J. R. Hershey, J. Le Roux, and L. Atlas · 2016

Later among the works it cites.

User-transparent distributed TensorFlow

A. Vishnu, J. Manzano, C. Siegel, and J. Daily · 2017

Closest in time.