Fetching the paper…
Reading the bibliography…
This work attempts to explain the types of computation that neural networks can perform by relating them to automata.
Three models for the description of language
Noam Chomsky. 1956 · 1956
Earlier work this paper cites.
Turing machines with restricted memory access
Patrick C Fischer. 1966 · 1966
Earlier work this paper cites.
Counter machines and counter languages
Patrick C. Fischer, Albert R. Meyer, and Arnold L. Rosenberg. 1968 · 1968
Earlier work this paper cites.
Finding structure in time
Jeffrey L Elman. 1990 · 1990
Earlier work this paper cites.
On the computational power of neural nets
Hava T. Siegelmann and Eduardo D. Sontag. 1992 · 1992
Earlier work this paper cites.
Training with noise is equivalent to Tikhonov regularization
Chris M. Bishop. 1995 · 1995
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997
Earlier work this paper cites.
Tier-based strictly local constraints for phonology
Jeffrey Heinz, Chetan Rawal, and Herbert G Tanner. 2011 · 2011
Earlier work this paper cites.
Aural pattern recognition experiments and the subregular hierarchy
James Rogers and Geoffrey K Pullum. 2011 · 2011
Cited alongside, same era.
Imagenet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012 · 2012
Cited alongside, same era.
Neural machine translation by jointly learning to align and translate
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014 · 2014
Cited alongside, same era.
Learning phrase representations using RNN encoder–decoder for statistical machine translation
Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014 · 2014
Cited alongside, same era.
Attention-based models for speech recognition
Jan K Chorowski, Dzmitry Bahdanau, Dmitriy Serdyuk, Kyunghyun Cho, and Yoshua Bengio. 2015 · 2015
Cited alongside, same era.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Later among the works it cites.
Context-free transductions with neural stacks
Yiding Hao, William Merrill, Dana Angluin, Robert Frank, Noah Amsel, Andrew Benz, and Simon Mendelsohn. 2018 · 2018
Later among the works it cites.
Hao Peng, Roy Schwartz, Sam Thomson, and Noah A Smith. 2018 · 2018
Later among the works it cites.
Improving language understanding by generative pre-training
Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018 · 2018
Later among the works it cites.
On the practical computational power of finite precision RNNs for language recognition
Gail Weiss, Yoav Goldberg, and Eran Yahav. 2018 · 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Minh-Thang Luong, Hieu Pham, and Christopher D Manning. 2015 · 2015
Cited alongside, same era.
Character-aware neural language models
Yoon Kim, Yacine Jernite, David Sontag, and Alexander M Rush. 2016 · 2016
Cited alongside, same era.
Regularizing deep neural networks by noise: Its interpretation and optimization
Hyeonwoo Noh, Tackgeun You, Jonghwan Mun, and Bohyung Han. 2017 · 2017
Cited alongside, same era.
Later among the works it cites.
Investigating capsule networks with dynamic routing for text classification
Wei Zhao, Jianbo Ye, Min Yang, Zeyang Lei, Suofei Zhang, and Zhou Zhao. 2018 · 2018
Later among the works it cites.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019
Closest in time.
On the linguistic capacity of real-time counter automata
William Merrill. 2020 · 2020
Closest in time.