Fetching the paper…
Reading the bibliography…
Recent studies have shown that deep learning models such as RNNs and Transformers have brought significant performance gains for long-term forecasting of time series because they effectively utilize historical information.
Some recent advances in forecasting and control
Box, G. E. P. and Jenkins, G. M · 1968
Earlier work this paper cites.
Distribution of residual autocorrelations in autoregressive-integrated moving average time series models
Box, G. E. P. and Pierce, D. A · 1970
Earlier work this paper cites.
The accuracy of extrapolation (time series) methods: Results of a forecasting competition
Makridakis, S., Andersen, A., Carbone, R., Fildes, R., Hibon, M., Lewandowski, R., Newton, J., Parzen, E., and Winkler, R · 1982
Earlier work this paper cites.
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., and Bengio, Y · 2013
Earlier work this paper cites.
Empirical evaluation of gated recurrent neural networks on sequence modeling
Chung, J., Gülçehre, Ç., Cho, K., and Bengio, Y · 2014
Earlier work this paper cites.
Adam: A Method for Stochastic Optimization
Kingma, D. P. and Ba, J · 2017
Earlier work this paper cites.
A dual-stage attention-based recurrent neural network for time series prediction
Qin, Y., Song, D., Chen, H., Cheng, W., Jiang, G., and Cottrell, G. W · 2017
Earlier work this paper cites.
Attention is all you need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I · 2017
Earlier work this paper cites.
Modeling long-and short-term temporal patterns with deep neural networks
Lai, G., Chang, W.-C., Yang, Y., and Liu, H · 2018
Earlier work this paper cites.
Deep state space models for time series forecasting
Rangapuram, S. S., Seeger, M. W., Gasthaus, J., Stella, L., Wang, Y., and Januschowski, T · 2018
Earlier work this paper cites.
Multilevel wavelet decomposition network for interpretable time series analysis
Wang, J., Wang, Z., Li, J., and Wu, J · 2018
Earlier work this paper cites.
Learning long term dependencies via fourier recurrent units
Zhang, J., Lin, Y., Song, Z., and Dhillon, I. S · 2018
Earlier work this paper cites.
BERT: pre-training of deep bidirectional transformers for language understanding
Devlin, J., Chang, M., Lee, K., and Toutanova, K · 2019
Cited alongside, same era.
Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting
Li, S., Jin, X., Xuan, Y., Zhou, X., Chen, W., Wang, Y.-X., and Yan, X · 2019
Cited alongside, same era.
N-BEATS: Neural basis expansion analysis for interpretable time series forecasting
Oreshkin, B. N., Carpov, D., Chapados, N., and Bengio, Y · 2019
Cited alongside, same era.
Pytorch: An imperative style, high-performance deep learning library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., Desmaison, A., Kopf, A., Yang, E., DeVito, Z., Raison, M., Tejani, A., Chilamkurthy, S., Steiner, B., Fang, L., Bai, J., and Chintala, S · 2019
Cited alongside, same era.
Think globally, act locally: A deep neural network approach to high-dimensional time series forecasting
Sen, R., Yu, H., and Dhillon, I. S · 2019
Cited alongside, same era.
An image is worth 16x16 words: Transformers for image recognition at scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., and Houlsby, N · 2021
Later among the works it cites.
Multiwavelet-based operator learning for differential equations
Gupta, G., Xiao, X., and Bogdan, P · 2021
Later among the works it cites.
Reversible instance normalization for accurate time-series forecasting against distribution shift
Kim, T., Kim, J., Tae, Y., Park, C., Choi, J.-H., and Choo, J · 2021
Later among the works it cites.
FNet: Mixing tokens with fourier transforms
Lee-Thorp, J., Ainslie, J., Eckstein, I., and Ontañón, S · 2021
Later among the works it cites.
Global filter networks for image classification
Rao, Y., Zhao, W., Zhu, Z., Lu, J., and Zhou, J · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Legendre memory units: Continuous-time representation in recurrent neural networks
Voelker, A., Kajić, I., and Eliasmith, C · 2019
Cited alongside, same era.
Hippo: Recurrent memory with optimal polynomial projections
Gu, A., Dao, T., Ermon, S., Rudra, A., and Ré, C · 2020
Cited alongside, same era.
Reformer: The efficient transformer
Kitaev, N., Kaiser, L., and Levskaya, A · 2020
Cited alongside, same era.
Fourier neural operator for parametric partial differential equations
Li, Z., Kovachki, N. B., Azizzadenesheli, K., Liu, B., Bhattacharya, K., Stuart, A. M., and Anandkumar, A · 2020
Cited alongside, same era.
DeepAR: Probabilistic forecasting with autoregressive recurrent networks
Salinas, D., Flunkert, V., Gasthaus, J., and Januschowski, T · 2020
Cited alongside, same era.
Long range arena: A benchmark for efficient transformers
Tay, Y., Dehghani, M., Abnar, S., Shen, Y., Bahri, D., Pham, P., Rao, J., Yang, L., Ruder, S., and Metzler, D · 2020
Cited alongside, same era.
Efficiently modeling long sequences with structured state spaces
Gu, A., Goel, K., and Ré, C
Cited in the paper.
Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting
Wu, H., Xu, J., Wang, J., and Long, M · 2021
Later among the works it cites.
Informer: Beyond efficient transformer for long sequence time-series forecasting
Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., and Zhang, W · 2021
Later among the works it cites.
N-hits: Neural hierarchical interpolation for time series forecasting
Challu, C., Olivares, K. G., Oreshkin, B. N., Garza, F., Mergenthaler, M., and Dubrawski, A · 2022
Closest in time.
Pyraformer: Low-complexity pyramidal attention for long-range time series modeling and forecasting
Liu, S., Yu, H., Liao, C., Li, J., Lin, W., Liu, A. X., and Dustdar, S · 2022
Closest in time.
Transformers in time series: A survey
Wen, Q., Zhou, T., Zhang, C., Chen, W., Ma, Z., Yan, J., and Sun, L · 2022
Closest in time.
FEDformer: Frequency enhanced decomposed transformer for long-term series forecasting
Zhou, T., Ma, Z., Wen, Q., Wang, X., Sun, L., and Jin, R · 2022
Closest in time.