Fetching the paper…
Reading the bibliography…
In this work, we firstly apply the Train-Tensor (TT) networks to construct a compact representation of the classical Multilayer Perceptron, representing a reduction of up to 95% of the coefficients.
S. Efthymiou, J. Hidary, S. Leichenauer, Tensor Network for Machine Learning (2019) · 1906
Earlier work this paper cites.
A. E. Hoerl, R. W. Kennard, Ridge regression: Biased estimation for nonorthogonal problems, Technometrics 12 (1970) 55–67
1970
Earlier work this paper cites.
doi:10.1137/0713009
C. F. van Loan, Generalizing the singular value decomposition, Siam Journal on Numerical Analysis - SIAM J NUMER ANAL 13 (1976) 76–83 · 1976
Earlier work this paper cites.
doi:https://doi.org/10.1016/0304-4149(77)90052-7
P. Robinson, The estimation of a nonlinear moving average model , Stochastic Processes and their Applications 5 (1) (1977) 81 – 90 · 1977
Earlier work this paper cites.
doi:10.1007/BF01932285
L. Eldén, Algorithms for the regularization of ill-conditioned least squares problems, BIT Numerical Mathematics 17 (2) (1977) 134–145 · 1977
Earlier work this paper cites.
M. C. Mackey, L. Glass, Oscillation and chaos in physiological control systems , Science 197 (4300) (1977) 287–289. URL http://www.jstor.org/stable/1744526
1977
Earlier work this paper cites.
R. Engle, Autoregressive conditional heteroscedasticity with estimates of the variance of united kingdom inflation , Econometrica 50 (4) (1982) 987–1007. URL https://EconPapers.repec.org/RePEc:ecm:emetrp:v:50:y:1982:i:4:p:987-1007
1982
Earlier work this paper cites.
doi:10.1007/BF01934412
L. Eldén, A weighted pseudoinverse, generalized singular values, and constrained least squares problems , BIT Numerical Mathematics 22 (4) (1982) 487–502 · 1982
Earlier work this paper cites.
doi:https://doi.org/10.1016/0167-2789(82)90042-2
J. D. Farmer, Chaotic attractors of an infinite–dimensional dynamical system, Physica D: Nonlinear Phenomena 4 (3) (1982) 366 – 393 · 1982
Earlier work this paper cites.
A. Pankratz, Forecasting with Univariate Box-Jenkins Models: Concepts and Cases, John Wiley, New York, 1983
1983
Earlier work this paper cites.
doi:10.1007/BF01941141
Å. Björck, A bidiagonalization algorithm for solving large and sparse ill-posed systems of linear equations, BIT Numerical Mathematics 28 (3) (1988) 659–670 · 1988
Earlier work this paper cites.
doi:10.1007/BF02219234
P. C. Hansen, Regularization, GSVD and truncated GSVD , BIT Numerical Mathematics 29 (3) (1989) 491–504 · 1989
Earlier work this paper cites.
M. Kendall, A. Stuart, J. K. Ord, Kendall’s advanced theory of statistics Volume 2: Classical inference and relationship (Fifth edition), Oxford University Press, Oxford, 1991
1991
Earlier work this paper cites.
doi:10.1007/BF00994018
C. Cortes, V. Vapnik, Support-vector networks , Machine Learning 20 (3) (1995) 273–297 · 1995
Earlier work this paper cites.
R. Tibshirani, Regression shrinkage and selection via the lasso, Journal of the Royal Statistical Society, Series B 58 (1996) 267–288
1996
Earlier work this paper cites.
doi:10.1109/72.478403
E. S. Chng, S. Chen, B. Mulgrew, Gradient radial basis function networks for nonlinear and nonstationary time series prediction, IEEE Transactions on Neural Networks 7 (1) (1996) 190–194 · 1996
Earlier work this paper cites.
M. Adya, F. L. Collopy, How effective are neural networks at forecasting and prediction? a review and evaluation, Journal of Forecasting 17 (1998) 481–495
1998
Earlier work this paper cites.
doi:10.1109/72.935093
T. Van Gestel, J. A. K. Suykens, D. . Baestaens, A. Lambrechts, G. Lanckriet, B. Vandaele, B. De Moor, J. Vandewalle, Financial time series prediction using least squares support vector machines within the evidence framework, IEEE Transactions on Neural Networks 12 (4) (2001) 809–821 · 2001
Earlier work this paper cites.
J. Reyes, M. Stoudenmire, A multi-scale tensor network architecture for classification and regression (2020) · 2001
Earlier work this paper cites.
doi:10.1109/72.950144
Henry Leung, Titus Lo, Sichun Wang, Prediction of noisy chaotic time series using an optimal radial basis function neural network, IEEE Transactions on Neural Networks 12 (5) (2001) 1163–1172 · 2001
Earlier work this paper cites.
doi:10.1109/TNN.2003.820556
L. J. Cao, F. E. H. Tay, Support vector machine with adaptive parameters in financial time series forecasting, IEEE Transactions on Neural Networks 14 (6) (2003) 1506–1518 · 2003
Earlier work this paper cites.
doi:10.1109/ISCAS.2003.1206419
T. Raicharoen, C. Lursinsap, P. Sanguanbhokai, Application of critical support vector machine to time series prediction, in: Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS ’03., Vol. 5, 2003, pp. V–V · 2003
Cited alongside, same era.
B. Lim, S. Zohren, Time series forecasting with deep learning: A survey (2020) · 2004
Cited alongside, same era.
H. Zou, T. Hastie, Regularization and variable selection via the elastic net, Journal of the Royal Statistical Society, Series B 67 (2005) 301–320
2005
Cited alongside, same era.
A. Murua, R. Ramakrishnan, X. Li, R. H. Yang, V. P. Nia, Tensor train decompositions on recurrent networks (2020) · 2006
Cited alongside, same era.
C. M. Bishop, Pattern recognition and machine learning, Springer, 2006
2006
Cited alongside, same era.
doi:https://doi.org/10.1016/j.cam.2013.04.019
L. Dykes, L. Reichel, Simplified GSVD computations for the solution of linear discrete ill-posed problems , Journal of Computational and Applied Mathematics 255 (2014) 15 – 27 · 2013
Later among the works it cites.
doi:https://doi.org/10.1016/j.aop.2014.06.013
R. Orús, A practical introduction to tensor networks: Matrix product states and projected entangled pair states , Annals of Physics 349 (2014) 117–158 · 2014
Later among the works it cites.
G. Box, G. Jenkins, G. Reinsel, G. Ljung, Time Series Analysis: Forecasting and Control , Wiley Series in Probability and Statistics, Wiley, 2015. URL https://books.google.com.br/books?id=rNt5CgAAQBAJ
2015
Later among the works it cites.
A. Novikov, D. Podoprikhin, A. Osokin, D. P. Vetrov, Tensorizing neural networks, in: Advances in Neural Information Processing Systems (NIPS), 2015, pp. 442–450
2015
Later among the works it cites.
doi:10.1561/2200000059
A. Cichocki, N. Lee, I. Oseledets, A.-H. Phan, Q. Zhao, D. P. Mandic, Tensor networks for dimensionality reduction and large-scale optimization: Part 1 low-rank tensor decompositions , Foundations and Trends® in Machine Learning 9 (4-5) (2016) 249–429 · 2016
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
doi:https://doi.org/10.1016/j.amc.2006.07.033
H. Gu, H. Wang, Fuzzy prediction of chaotic time series based on singular value decomposition , Applied Mathematics and Computation 185 (2) (2007) 1171 – 1185, special Issue on Intelligent Computing Theory and Methodology · 2006
Cited alongside, same era.
doi:10.1007/s11075-007-9080-8
S. Morigi, L. Reichel, F. Sgallari, Orthogonal projection regularization operators , Numerical Algorithms 44 (2) (2007) 99–114 · 2007
Cited alongside, same era.
doi:https://doi.org/10.1016/j.chaos.2008.09.057
H. Mirzaee, Linear combination rule in genetic algorithm for optimization of finite impulse response neural network to predict natural chaotic time series , Chaos, Solitons & Fractals 41 (5) (2009) 2681 – 2689 · 2008
Cited alongside, same era.
I. V. Oseledets, E. Tyrtyshnikov, Breaking the curse of dimensionality, or how to use SVD in many dimensions, SIAM Journal on Scientific Computing 31 (5) (2009) 3744–3759
2009
Cited alongside, same era.
doi:10.1137/07070111X
T. G. Kolda, B. W. Bader, Tensor decompositions and applications , SIAM Rev. 51 (3) (2009) 455–500 · 2009
Cited alongside, same era.
T. Hastie, R. Tibshirani, J. Friedman, The elements of statistical learning: data mining, inference and prediction , 2nd Edition, Springer, 2009. URL http://www-stat.stanford.edu/~tibs/ElemStatLearn/
2009
Cited alongside, same era.
I. V. Oseledets, Tensor-train decomposition., SIAM J. Scientific Computing 33 (5) (2011) 2295–2317
2011
Cited alongside, same era.
Later among the works it cites.
doi:10.1561/2200000067
A. Cichocki, N. Lee, I. Oseledets, A.-H. Phan, Q. Zhao, M. Sugiyama, D. P. Mandic, Tensor networks for dimensionality reduction and large-scale optimization: Part 2 applications and future perspectives , Foundations and Trends® in Machine Learning 9 (6) (2017) 249–429 · 2017
Later among the works it cites.
Y. Yang, T. M. Hospedales, Deep multi-task representation learning: A tensor factorisation approach , in: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings, OpenReview.net, 2017. URL https://openreview.net/forum?id=SkhU2fcll
2017
Later among the works it cites.
A. Novikov, M. Trofimov, I. Oseledets, Exponential machines (2017) · 2017
Later among the works it cites.
A. Hallam, E. Grant, V. Stojevic, S. Severini, A. G. Green, Compact Neural Networks based on the Multiscale Entanglement Renormalization Ansatz (2018) · 2018
Later among the works it cites.
S. Reddi, S. Kale, S. Kumar, On the convergence of Adam and Beyond, in: International Conference on Learning Representations, 2018
2018
Later among the works it cites.
R. Yu, S. Zheng, A. Anandkumar, Y. Yue, Long-term forecasting using higher order tensor rnns (2019) · 2019
Later among the works it cites.
doi:10.1109/TNNLS.2019.2956926
A. H. Phan, A. Cichocki, A. Uschmajew, P. Tichavský, G. Luta, D. P. Mandic, Tensor networks for latent variable analysis: Novel algorithms for tensor train approximation, IEEE Transactions on Neural Networks and Learning Systems 31 (11) (2020) 4622–4636 · 2019
Later among the works it cites.
doi:10.1109/JPROC.2020.2976475
L. Deng, G. Li, S. Han, L. Shi, Y. Xie, Model compression and hardware acceleration for neural networks: A comprehensive survey, Proceedings of the IEEE 108 (4) (2020) 485–532 · 2020
Later among the works it cites.
doi:10.1103/PhysRevB.101.075135
Z.-Z. Sun, C. Peng, D. Liu, S.-J. Ran, G. Su, Generative tensor network classification model for supervised machine learning , Phys. Rev. B 101 (2020) 075135 · 2020
Later among the works it cites.
J. Kossaifi, Z. C. Lipton, A. Kolbeinsson, A. Khanna, T. Furlanello, A. Anandkumar, Tensor regression networks (2020) · 2020
Later among the works it cites.
doi:10.1109/LSP.2020.2990313
F. Sedighin, A. Cichocki, T. Yokota, Q. Shi, Matrix and tensor completion in multiway delay embedded space using tensor train, with application to signal reconstruction, IEEE Signal Processing Letters 27 (2020) 810–814 · 2020
Later among the works it cites.
E. Guo, D. Draper, Infinitely Wide Tensor Networks as Gaussian Process (2021) · 2021
Closest in time.
F. Sedighin, A. Cichocki, H. A. Phan, Adaptive rank selection for tensor ring decomposition, IEEE Journal of Selected Topics in Signal Processing (2021) 1–1 doi:10.1109/JSTSP.2021.3051503
2021
Closest in time.
A. Cichocki, Era of big data processing: A new approach via tensor networks and tensor decompositions (2014) · 2048
Closest in time.
doi:10.1016/S0169-2070(97)00044-7
P. Zhang, E. Patuwo, M. Hu, Forecasting with artificial neural networks: The state of the art, International Journal of Forecasting 14 (1998) 35–62 · 2070
Closest in time.