On Evaluating the Generalization of LSTM Models in Formal Languages

Inductive inference of formal languages from positive data

Dana Angluin. 1980 · 1980

Earlier work this paper cites.

Distributed representations, simple recurrent networks, and grammatical structure

Jeffrey L Elman. 1991 · 1991

Earlier work this paper cites.

Learning context-free grammars: Capabilities and limitations of a recurrent neural network with an external stack memory

Sreerupa Das, C Lee Giles, and Guo-Zheng Sun. 1992 · 1992

Earlier work this paper cites.

Learning and extracting finite state automata with second-order recurrent neural networks

C Lee Giles, Clifford B Miller, Dong Chen, Hsing-Hen Chen, Guo-Zheng Sun, and Yee-Chun Lee. 1992 · 1992

Earlier work this paper cites.

On the computational power of neural nets

Hava T Siegelmann and Eduardo D Sontag. 1992 · 1992

Earlier work this paper cites.

Tail-recursive distributed representations and simple recurrent networks

Stan C Kwasny and Barry L Kalman. 1995 · 1995

Earlier work this paper cites.

Computation beyond the Turing limit

Hava T Siegelmann. 1995 · 1995

Earlier work this paper cites.

Learning to count without a counter: A case study of dynamics and activation landscapes in recurrent networks

Janet Wiles and Jeff Elman. 1995 · 1995

Earlier work this paper cites.

The dynamics of discrete-time computation, with application to recurrent neural networks and finite state machine extraction

Mike Casey. 1996 · 1996

Earlier work this paper cites.

A recurrent network that performs a context-sensitive prediction task

Mark Steijvers and Peter Grünwald. 1996 · 1996

Cited alongside, same era.

Long short-term memory

Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997

Cited alongside, same era.

Designing a counter: Another case study of dynamics and activation landscapes in recurrent networks

Steffen Hölldobler, Yvonne Kalinke, and Helko Lehmann. 1997 · 1997

Cited alongside, same era.

A Recurrent Neural Network that learns to count

Paul Rodriguez, Janet Wiles, and Jeffrey L. Elman. 1999 · 1999

Cited alongside, same era.

Context-free and context-sensitive dynamics in recurrent neural networks

Mikael Bodén and Janet Wiles. 2000 · 2000

Cited alongside, same era.

LSTM recurrent networks learn simple context-free and context-sensitive languages

Felix A Gers and E Schmidhuber. 2001 · 2001

Neural machine translation by jointly learning to align and translate

Original

Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014 · 2014

Later among the works it cites.

Long short-term memory recurrent neural network architectures for large scale acoustic modeling

Hasim Sak, Andrew W. Senior, and Françoise Beaufays. 2014 · 2014

Later among the works it cites.

Sequence to Sequence Learning with Neural Networks

Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014 · 2014

Later among the works it cites.

LSTM: A search space odyssey

Klaus Greff, Rupesh K Srivastava, Jan Koutník, Bas R Steunebrink, and Jürgen Schmidhuber. 2017 · 2017

Later among the works it cites.

Automatic differentiation in PyTorch

Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017 · 2017

Later among the works it cites.