Fetching the paper…
Reading the bibliography…
Sequence prediction and classification are ubiquitous and challenging problems in machine learning that can require identifying complex dependencies between temporally distant inputs.
Distance measures for speech recognition: Psychological and instrumental
Mermelstein, P · 1976
Earlier work this paper cites.
Learning internal representations by error propagation
Rumelhart, D. E., Hinton, G. E., and Williams, R. J · 1986
Earlier work this paper cites.
The utility driven dynamic error propagation network
Robinson, A. J. and Fallside, F · 1987
Earlier work this paper cites.
Finding structure in time
Elman, J. L · 1988
Earlier work this paper cites.
Generalization of backpropagation with application to a recurrent gas market model
Werbos, P. J · 1988
Earlier work this paper cites.
Complexity of exact gradient computation algorithms for recurrent neural networks
Williams, R. J · 1989
Earlier work this paper cites.
Untersuchungen zu dynamischen neuronalen Netzen. Diploma thesis, Institut für Informatik, Lehrstuhl Prof. Brauer, Technische Universität München, 1991
Hochreiter, S · 1991
Earlier work this paper cites.
Neural sequence chunkers
Schmidhuber, J · 1991
Earlier work this paper cites.
Induction of multiscale temporal structure
Mozer, M. C · 1992
Earlier work this paper cites.
Learning complex, extended sequences using the principle of history compression
Schmidhuber, J · 1992
Earlier work this paper cites.
Training recurrent networks using the extended kalman filter
Williams, Ronald J · 1992
Earlier work this paper cites.
DARPA TIMIT acoustic phonetic continuous speech corpus CD-ROM, 1993
Garofolo, J. S., Lamel, L. F., Fisher, W. M., Fiscus, J. G., Pallett, D. S., and Dahlgren, N. L · 1993
Cited alongside, same era.
Learning sequential tasks by incrementally adding higher orders
Ring, Mark · 1993
Cited alongside, same era.
Neural network music composition by prediction: Exploring the benefits of psychoacoustic constraints and multi-scale processing
Mozer, M. C · 1994
Cited alongside, same era.
Learning long-term dependencies in NARX recurrent neural networks
Lin, T., Horne, B.G., Tino, P., and Giles, C.L · 1996
Cited alongside, same era.
Long short-term memory
Hochreiter, S. and Schmidhuber, J · 1997
Cited alongside, same era.
Gradient flow in recurrent nets: the difficulty of learning long-term dependencies
Hochreiter, S., Bengio, Y., Frasconi, P., and Schmidhuber, J · 2001
Sequence labelling in structured domains with hierarchical recurrent neural networks
Fernandez, Santiago, Graves, Alex, and Schmidhuber, Jürgen · 2007
Later among the works it cites.
Training recurrent networks by Evolino
Schmidhuber, J., Wierstra, D., Gagliolo, M., and Gomez, F. J · 2007
Later among the works it cites.
A novel connectionist system for improved unconstrained handwriting recognition
Graves, A., Liwicki, M., Fernandez, S., Bertolami, R., Bunke, H., and Schmidhuber, J · 2009
Later among the works it cites.
Offline handwriting recognition with multidimensional recurrent neural networks
Graves, Alex and Schmidhuber, Jürgen · 2009
Later among the works it cites.
Temporal-kernel recurrent neural networks
Sutskever, Ilya and Hinton, Geoffrey · 2010
Later among the works it cites.
Learning recurrent neural networks with Hessian-free optimization
Martens, J. and Sutskever, I · 2011
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Short term memory in echo state networks
Jaeger, H · 2002
Cited alongside, same era.
Rapid retraining on speech data with LSTM recurrent networks
Graves, A., Beringer, N., and Schmidhuber, J · 2005
Cited alongside, same era.
Evolino: Hybrid neuroevolution / optimal linear search for sequence prediction
Schmidhuber, J., Wierstra, D., and Gomez, F. J · 2005
Cited alongside, same era.
Connectionist temporal classification: Labelling unsegmented sequence data with recurrent neural nets
Graves, A., Fernandez, S., Gomez, F. J., and Schmidhuber, J · 2006
Cited alongside, same era.
A system for robotic heart surgery that learns to tie knots using recurrent neural networks
Mayer, Hermann, Gomez, Faustino J., Wierstra, Daan, Nagy, Istvan, Knoll, Alois, and Schmidhuber, Juergen · 2006
Cited alongside, same era.
Later among the works it cites.
Recurrent transition hierarchies for continual learning: A general overview
Ring, Mark · 2011
Later among the works it cites.
Generating text with recurrent neural networks
Sutskever, I., Martens, J., and Hinton, G · 2011
Later among the works it cites.
Speech recognition with deep recurrent neural networks
Graves, Alex, rahman Mohamed, Abdel, and Hinton, Geoffrey E · 2013
Later among the works it cites.
On the importance of initialization and momentum in deep learning
Sutskever, Ilya, Martens, James, Dahl, George E., and Hinton, Geoffrey E · 2013
Later among the works it cites.
Sak, Haşim, Senior, Andrew, and Beaufays, Françoise · 2014
Closest in time.