Fetching the paper…
Reading the bibliography…
We propose a novel {\it Equilibrated Recurrent Neural Network} (ERNN) to combat the issues of inaccuracy and instability in conventional RNNs.
Inexact newton methods
Dembo, R. S., Eisenstat, S. C., and Steihaug, T · 1982
Earlier work this paper cites.
Two-point step size gradient methods
Barzilai, J. and Borwein, J. M · 1988
Earlier work this paper cites.
A learning algorithm for continually running fully recurrent neural networks
Williams, R. J. and Zipser, D · 1989
Earlier work this paper cites.
Backpropagation through time: what it does and how to do it
Werbos, P. J · 1990
Earlier work this paper cites.
Long short-term memory
Hochreiter, S. and Schmidhuber, J · 1997
Earlier work this paper cites.
Serial order: A parallel distributed processing approach
Jordan, M. I · 1997
Earlier work this paper cites.
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., and Haffner, P · 1998
Earlier work this paper cites.
The autapse: a simple illustration of short-term analog memory storage by tuned synaptic feedback
Seung, H. S., Lee, D. D., Reis, B. Y., and Tank, D. W · 2000
Earlier work this paper cites.
Stability analysis of discrete-time recurrent neural networks
Barabanov, N. E. and Prokhorov, D. V · 2002
Earlier work this paper cites.
Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the" echo state network" approach , volume 5
Jaeger, H · 2002
Earlier work this paper cites.
Autapse turns neuron into oscillator
Herrmann, C. S. and Klaus, A · 2004
Earlier work this paper cites.
Comparative study on classifying human activities with miniature inertial and magnetic sensors
Altun, K., Barshan, B., and Tunçel, O · 2010
Earlier work this paper cites.
Learning recurrent neural networks with hessian-free optimization
Martens, J. and Sutskever, I · 2011
Earlier work this paper cites.
Human activity recognition on smartphones using a multiclass hardware-friendly support vector machine
Anguita, D., Ghio, A., Oneto, L., Parra, X., and Reyes-Ortiz, J. L · 2012
Earlier work this paper cites.
Hidden factors and hidden topics: Understanding rating dimensions with review text
McAuley, J. and Leskovec, J · 2013
Earlier work this paper cites.
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., and Bengio, Y · 2013
Earlier work this paper cites.
On the properties of neural machine translation: Encoder-decoder approaches
Cho, K., Van Merriënboer, B., Bahdanau, D., and Bengio, Y · 2014
Cited alongside, same era.
Sequence to sequence learning with neural networks
Sutskever, I., Vinyals, O., and Le, Q. V · 2014
Cited alongside, same era.
Hessian-free optimization for learning deep multidimensional recurrent neural networks
Cho, M., Dhir, C., and Lee, J · 2015
Cited alongside, same era.
Adam: A method for stochastic optimization
Kingma, D. P. and Ba, J · 2015
Cited alongside, same era.
Emitting waves from defects in network with autapses
Qin, H., Wu, Y., Wang, C., and Ma, J · 2015
Cited alongside, same era.
Unitary evolution recurrent neural networks
Arjovsky, M., Shah, A., and Bengio, Y · 2016
Tunable efficient unitary neural networks (eunn) and their application to rnns
Jing, L., Shen, Y., Dubček, T., Peurifoy, J., Skirlo, S., LeCun, Y., Tegmark, M., and Soljačić, M · 2017
Later among the works it cites.
Lei, T., Zhang, Y., and Artzi, Y · 2017
Later among the works it cites.
Pointnet: Deep learning on point sets for 3d classification and segmentation
Qi, C. R., Su, H., Mo, K., and Guibas, L. J · 2017
Later among the works it cites.
Unbiased online recurrent optimization
Tallec, C. and Ollivier, Y · 2017
Later among the works it cites.
Attention is all you need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., and Polosukhin, I · 2017
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Quasi-recurrent neural networks
Bradbury, J., Merity, S., Xiong, C., and Socher, R · 2016
Cited alongside, same era.
Capacity and Trainability in Recurrent Neural Networks
Collins, J., Sohl-Dickstein, J., and Sussillo, D · 2016
Cited alongside, same era.
Memory-efficient backpropagation through time
Gruslys, A., Munos, R., Danihelka, I., Lanctot, M., and Graves, A · 2016
Cited alongside, same era.
Wavenet: A generative model for raw audio
van den Oord, A., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A. W., and Kavukcuoglu, K · 2016
Cited alongside, same era.
Skip rnn: Learning to skip state updates in recurrent neural networks
Campos, V., Jou, B., Giró-i Nieto, X., Torres, J., and Chang, S.-F · 2017
Cited alongside, same era.
Dilated recurrent neural networks
Chang, S., Zhang, Y., Han, W., Yu, M., Guo, X., Tan, W., Cui, X., Witbrock, M., Hasegawa-Johnson, M. A., and Huang, T. S · 2017
Cited alongside, same era.
Yelp, I · 2017
Later among the works it cites.
Autapses promote synchronization in neuronal networks
Fan, H., Wang, Y., Wang, H., Lai, Y.-C., and Wang, X · 2018
Later among the works it cites.
Reviving and improving recurrent back-propagation
Liao, R., Xiong, Y., Fetaya, E., Zhang, L., Yoon, K., Pitkow, X., Urtasun, R., and Zemel, R · 2018
Later among the works it cites.
Reversible recurrent neural networks
MacKay, M., Vicol, P., Ba, J., and Grosse, R. B · 2018
Later among the works it cites.
Parallelizing linear recurrent neural nets over sequence length
Martin, E. and Cundy, C · 2018
Later among the works it cites.
Edge machine learning
Microsoft · 2018
Later among the works it cites.
When recurrent models don’t need to be recurrent
Miller, J. and Hardt, M · 2018
Later among the works it cites.
Approximating real-time recurrent learning with random kronecker factors
Mujika, A., Meier, F., and Steger, A · 2018
Later among the works it cites.
Speech Commands: A Dataset for Limited-Vocabulary Speech Recognition
Warden, P · 2018
Later among the works it cites.
Stabilizing gradients for deep neural networks via efficient svd parameterization
Zhang, J., Lei, Q., and Dhillon, I. S · 2018
Later among the works it cites.