Nonlinear Systems Identification Using Deep Dynamic Neural Networks

F. Rosenblatt, “Principles of neurodynamics. perceptrons and the theory of brain mechanisms,” DTIC Document, Tech. Rep., 1961

1961

Earlier work this paper cites.

J. J. Hopfield, “Neural networks and physical systems with emergent collective computational abilities.” Proceedings of the National Academy of Sciences of the United States of America , vol. 79, no. 8, pp. 2554–2558, 1982

1982

Earlier work this paper cites.

D. E. Rumelhart and G. E. Hinton, “Learning representations by backpropagating errors,” Nature , vol. 323, no. 9, pp. 533 – 536, 1986

1986

Earlier work this paper cites.

T. J. Sejnowski and C. R. Rosenberg, “Parallel networks that learn to pronounce English text,” Complex systems , vol. 1, pp. 145–168, 1987

1987

Earlier work this paper cites.

G. Cybenko, “Approximations by superpositions of a sigmoidal function,” pp. 303–314, 1989

1989

Earlier work this paper cites.

K. Funahashi, “On the approximate realisation of continuous mappings by neural networks,” 1989

1989

Earlier work this paper cites.

K. Hornik, M. Stinchcombe, and H. White, “Multilayer feedforward networks are universal approximators,” Neural Networks , vol. 2, no. 5, pp. 359–366, 1989

1989

Earlier work this paper cites.

P. J. Werbos, “Backpropagation Through Time: What It Does and How to Do It,” Proceedings of the IEEE , vol. 78, no. 10, pp. 1550–1560, 1990

1990

Earlier work this paper cites.

K. S. Narendra and K. Parthasarathy, “Neural networks and dynamical systems,” International Journal of Approximate Reasoning , vol. 6, no. 2, pp. 109–131, 1992

1992

Earlier work this paper cites.

K. S. Narendra, “Identification and Control of Dynamical Systems Using Neural Networks,” 1992

1992

Cited alongside, same era.

B. Y. et al., “Learning long-term dependencies with gradient descent is difficult.” IEEE Transactions on Neural Networks , 1994, doi: 10.1109/72.279181

1994

Cited alongside, same era.

S. Hochreiter and J. Schmidhuber, “Long short-term memory.” Neural computation , vol. 9, no. 8, pp. 1735–80, 1997

1997

Cited alongside, same era.

Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proceedings of the IEEE , vol. 86, no. 11, pp. 2278–2323, 1998

1998

Cited alongside, same era.

J. Y. F. Yam and T. W. S. Chow, “Feedforward networks training speed enhancement by optimal initialization of the synaptic coefficients,” IEEE Transactions on Neural Networks , vol. 12, no. 2, pp. 430–434, 2001

I. Sutskever, “Training Recurrent neural Networks,” PhD thesis , p. 101, 2013

2013

Later among the works it cites.

A. Graves, A. Mohamed, and G. Hinton, “Speech Recognition with Deep Recurrent Neural Networks,” IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , no. 3, pp. 6645–6649, 2013

2013

Later among the works it cites.

M. D. Zeiler, M. Ranzato, R. Monga, M. Mao, K. Yang, Q. V. Le, P. Nguyen, a. Senior, V. Vanhoucke, J. Dean, and G. E. Hinton, “On rectified linear units for speech processing,” ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings , 2013

2013

Later among the works it cites.

W. Zaremba, I. Sutskever, and O. Vinyals, “Recurrent neural network regularization,” CoRR , vol. abs/1409.2329, 2014

Original

2014

Later among the works it cites.