Fetching the paper…
Reading the bibliography…
We propose a novel tensor network language model based on the simplest tensor network (i.e., tensor trains), called `Tensor Train Language Model' (TTLM).
Dynamic construction of finite-state automata from examples using hill-climbing
Tomita, M · 1982
Earlier work this paper cites.
A maximum likelihood approach to continuous speech recognition
Bahl, L. R., Jelinek, F., and Mercer, R. L · 1983
Earlier work this paper cites.
Probabilistic interpretation of feedforward classification network outputs, with relationships to statistical pattern recognition
Bridle, J. S · 1990
Earlier work this paper cites.
Backpropagation through time: what it does and how to do it
Werbos, P. J · 1990
Earlier work this paper cites.
An efficient gradient-based algorithm for on-line training of recurrent network trajectories
Williams, R. J. and Peng, J · 1990
Earlier work this paper cites.
First-order versus second-order single-layer recurrent neural networks
Goudreau, M. W., Giles, C. L., Chakradhar, S. T., and Chen, D · 1994
Earlier work this paper cites.
Building a large annotated corpus of english: The penn treebank
Marcinkiewicz, M. A · 1994
Earlier work this paper cites.
Long short-term memory
Hochreiter, S. and Schmidhuber, J · 1997
Earlier work this paper cites.
Rethinking eliminative connectionism
Marcus, G. F · 1998
Earlier work this paper cites.
A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics
Martin, D., Fowlkes, C., Tal, D., and Malik, J · 2001
Earlier work this paper cites.
Boosted decision trees as an alternative to artificial neural networks for particle identification
Roe, B. P., Yang, H.-J., Zhu, J., Liu, Y., Stancu, I., and McGregor, G · 2005
Earlier work this paper cites.
Clair collection of fraud email, acl data and code repository
Radev, D · 2008
Earlier work this paper cites.
Tensor Algebra and Tensor Analysis for Engineers: With Applications to Continuum Mechanics
Itskov, M · 2009
Earlier work this paper cites.
Factorization machines
Rendle, S · 2010
Earlier work this paper cites.
Are biological systems poised at criticality?
Mora, T. and Bialek, W · 2011
Earlier work this paper cites.
Tensor-train decomposition
Oseledets, I. V · 2011
Earlier work this paper cites.
Generating text with recurrent neural networks
Sutskever, I., Martens, J., and Hinton, G. E · 2011
Cited alongside, same era.
Context dependent recurrent neural network language model
Mikolov, T. and Zweig, G · 2012
Cited alongside, same era.
Criticality in large-scale brain fmri dynamics unveiled by a novel point process analysis
Tagliazucchi, E., Balenzuela, P., Fraiman, D., and Chialvo, D. R · 2012
Cited alongside, same era.
Mining pure high-order word associations via information geometry for information retrieval
Hou, Y., Zhao, X., Song, D., and Li, W · 2013
Cited alongside, same era.
Reservoir computing compensates slow response of chemosensor arrays exposed to fast varying gas concentrations in continuous monitoring
Fonollosa, J., Sheik, S., Huerta, R., and Marco, S · 2015
Cited alongside, same era.
Tensorizing neural networks
UCI machine learning repository, 2017
Dua, D. and Graff, C · 2017
Later among the works it cites.
Pestun, V. and Vlassopoulos, Y · 2017
Later among the works it cites.
Language as a matrix product state
Pestun, V., Terilla, J., and Vlassopoulos, Y · 2017
Later among the works it cites.
Attention is all you need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I · 2017
Later among the works it cites.
Expressive power of recurrent neural networks
Khrulkov, V., Novikov, A., and Oseledets, I · 2018
Later among the works it cites.
Benefits of depth for long-term memory of recurrent networks
Levine, Y., Sharir, O., and Shashua, A · 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Novikov, A., Podoprikhin, D., Osokin, A., and Vetrov, D. P · 2015
Cited alongside, same era.
Parameterized machine learning for high-energy physics
Baldi, P., Cranmer, K., Faucett, T., Sadowski, P., and Whiteson, D · 2016
Cited alongside, same era.
Convolutional rectifier networks as generalized tensor decompositions
Cohen, N. and Shashua, A · 2016
Cited alongside, same era.
On the expressive power of deep learning: A tensor analysis
Cohen, N., Sharir, O., and Shashua, A · 2016
Cited alongside, same era.
Deep learning , volume 1
Goodfellow, I., Bengio, Y., Courville, A., and Bengio, Y · 2016
Cited alongside, same era.
Critical behavior from deep dynamics: a hidden dimension in natural language
Lin, H. W. and Tegmark, M · 2016
Cited alongside, same era.
Pointer sentinel mixture models
Merity, S., Xiong, C., Bradbury, J., and Socher, R · 2016
Cited alongside, same era.
Later among the works it cites.
Connecting weighted automata and recurrent neural networks through spectral learning
Rabusseau, G., Li, T., and Precup, D · 2019
Later among the works it cites.
A generalized language model in tensor space
Zhang, L., Zhang, P., Ma, X., Gu, S., Su, Z., and Song, D · 2019
Later among the works it cites.
Tensor regression networks
Kossaifi, J., Lipton, Z. C., Kolbeinsson, A., Khanna, A., Furlanello, T., and Anandkumar, A · 2020
Later among the works it cites.
Language modeling with a general second-order rnn
Maupomé, D. and Meurs, M.-J · 2020
Later among the works it cites.
Exact holographic tensor networks for the motzkin spin chain
Alexander, R. N., Evenbly, G., and Klich, I · 2021
Later among the works it cites.
Language model evaluation beyond perplexity
Meister, C. and Cotterell, R · 2021
Later among the works it cites.
Tensor networks for probabilistic sequence modeling
Miller, J., Rabusseau, G., and Terilla, J · 2021
Later among the works it cites.
Tensor-train density estimation
Novikov, G. S., Panov, M. E., and Oseledets, I. V · 2021
Later among the works it cites.
Chapter 1 - tensor decompositions: computations, applications, and challenges
Bi, Y., Lu, Y., Long, Z., Zhu, C., and Liu, Y · 2022
Later among the works it cites.