Bidirectional Recurrent Neural Networks as Generative Models - Reconstructing Gaps in Time Series

Learning representations by back-propagating errors

Rumelhart, D. E., Hinton, G. E., and Williams, R. J. (1986) · 1986

Earlier work this paper cites.

Learning long-term dependencies with gradient descent is difficult

Bengio, Y., Simard, P., and Frasconi, P. (1994) · 1994

Earlier work this paper cites.

Long short-term memory

Hochreiter, S. and Schmidhuber, J. (1997) · 1997

Earlier work this paper cites.

Bidirectional recurrent neural networks

Schuster, M. and Paliwal, K. K. (1997) · 1997

Earlier work this paper cites.

Exploiting the past and the future in protein secondary structure prediction

Baldi, P., Brunak, S., Frasconi, P., Soda, G., and Pollastri, G. (1999) · 1999

Earlier work this paper cites.

Missing values in nonlinear factor analysis

Raiko, T. and Valpola, H. (2001) · 2001

Earlier work this paper cites.

A novel connectionist system for unconstrained handwriting recognition

Graves, A., Liwicki, M., Fernández, S., Bertolami, R., Bunke, H., and Schmidhuber, J. (2009) · 2009

Earlier work this paper cites.

Neural networks and learning machines

Haykin, S. (2009) · 2009

Earlier work this paper cites.

Theano: a CPU and GPU math expression compiler

Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., and Bengio, Y. (2010) · 2010

Earlier work this paper cites.

Understanding the difficulty of training deep feedforward neural networks

Glorot, X. and Bengio, Y. (2010) · 2010

Cited alongside, same era.

Missing-feature reconstruction with a bounded nonlinear state-space model

Remes, U., Palomäki, K., Raiko, T., Honkela, A., and Kurimo, M. (2011) · 2011

Cited alongside, same era.

Generating text with recurrent neural networks

Sutskever, I., Martens, J., and Hinton, G. E. (2011) · 2011

Cited alongside, same era.

Theano: new features and speed improvements

Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I. J., Bergeron, A., Bouchard, N., and Bengio, Y. (2012) · 2012

Cited alongside, same era.

Modeling temporal dependencies in high-dimensional sequences: Application to polyphonic music generation and transcription

Boulanger-Lewandowski, N., Bengio, Y., and Vincent, P. (2012) · 2012

Cited alongside, same era.

Generalized denoising auto-encoders as generative models

Training and analysing deep recurrent neural networks

Hermans, M. and Schrauwen, B. (2013) · 2013

Later among the works it cites.

On the difficulty of training recurrent neural networks

Pascanu, R., Mikolov, T., and Bengio, Y. (2013) · 2013

Later among the works it cites.

Learning stochastic recurrent networks

Original

Bayer, J. and Osendorfer, C. (2014) · 2014

Later among the works it cites.

A clockwork RNN

Koutník, J., Greff, K., Gomez, F., and Schmidhuber, J. (2014) · 2014

Later among the works it cites.

First-pass large vocabulary continuous speech recognition using bi-directional recurrent dnns

Original

Maas, A. L., Hannun, A. Y., Jurafsky, D., and Ng, A. Y. (2014) · 2014

Later among the works it cites.

Learning longer memory in recurrent neural networks