Fetching the paper…
Reading the bibliography…
We present General Time Transformer (GTT), an encoder-only style foundation model for zero-shot multivariate time series forecasting.
Some recent advances in forecasting and control
Box, G. E. and Jenkins, G. M · 1968
Earlier work this paper cites.
Vector autoregressive models for multivariate time series
Zivot, E. and Wang, J · 2006
Earlier work this paper cites.
Forecasting with exponential smoothing: the state space approach
Hyndman, R., Koehler, A. B., Ord, J. K., and Snyder, R. D · 2008
Earlier work this paper cites.
Time series analysis by state space methods , volume 38
Durbin, J. and Koopman, S. J · 2012
Earlier work this paper cites.
Adam: A method for stochastic optimization
Kingma, D. P. and Ba, J · 2014
Earlier work this paper cites.
Gaussian error linear units (gelus)
Hendrycks, D. and Gimpel, K · 2016
Earlier work this paper cites.
Conditional time series forecasting with convolutional neural networks
Borovykh, A., Bohte, S., and Oosterlee, C. W · 2017
Earlier work this paper cites.
Decoupled weight decay regularization
Loshchilov, I. and Hutter, F · 2017
Earlier work this paper cites.
Attention is all you need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I · 2017
Earlier work this paper cites.
Dilated convolutional neural networks for time series forecasting
Borovykh, A., Bohte, S., and Oosterlee, C. W · 2018
Earlier work this paper cites.
Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting
Li, S., Jin, X., Xuan, Y., Zhou, X., Chen, W., Wang, Y.-X., and Yan, X · 2019
Earlier work this paper cites.
An image is worth 16x16 words: Transformers for image recognition at scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al · 2020
Earlier work this paper cites.
Deepar: Probabilistic forecasting with autoregressive recurrent networks
Salinas, D., Flunkert, V., Gasthaus, J., and Januschowski, T · 2020
Earlier work this paper cites.
Monash time series forecasting archive
Godahewa, R., Bergmeir, C., Webb, G. I., Hyndman, R. J., and Montero-Manso, P · 2021
Cited alongside, same era.
Reversible instance normalization for accurate time-series forecasting against distribution shift
Kim, T., Kim, J., Tae, Y., Park, C., Choi, J.-H., and Choo, J · 2021
Cited alongside, same era.
Traffic4cast at neurips 2020-yet more on the unreasonable effectiveness of gridded geo-spatial processes
Kopp, M., Kreil, D., Neun, M., Jonietz, D., Martin, H., Herruzo, P., Gruca, A., Soleymani, A., Wu, F., Liu, Y., et al · 2021
Cited alongside, same era.
Pyraformer: Low-complexity pyramidal attention for long-range time series modeling and forecasting
Liu, S., Yu, H., Liao, C., Li, J., Lin, W., Liu, A. X., and Dustdar, S · 2021
Cited alongside, same era.
Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting
Wu, H., Xu, J., Wang, J., and Long, M · 2021
Llm4ts: Two-stage fine-tuning for time-series forecasting with pre-trained llms
Chang, C., Peng, W.-C., and Chen, T.-F · 2023
Later among the works it cites.
A decoder-only foundation model for time-series forecasting
Das, A., Kong, W., Sen, R., and Zhou, Y · 2023
Later among the works it cites.
Forecastpfn: Synthetically-trained zero-shot forecasting
Dooley, S., Khurana, G. S., Mohapatra, C., Naidu, S. V., and White, C · 2023
Later among the works it cites.
Tsmixer: Lightweight mlp-mixer model for multivariate time series forecasting
Ekambaram, V., Jati, A., Nguyen, N., Sinthong, P., and Kalagnanam, J · 2023
Later among the works it cites.
Garza, A. and Mergenthaler-Canseco, M · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Voice2series: Reprogramming acoustic models for time series classification
Yang, C.-H. H., Tsai, Y.-Y., and Chen, P.-Y · 2021
Cited alongside, same era.
Informer: Beyond efficient transformer for long sequence time-series forecasting
Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., and Zhang, W · 2021
Cited alongside, same era.
M5 accuracy competition: Results, findings, and conclusions
Makridakis, S., Spiliotis, E., and Assimakopoulos, V · 2022
Cited alongside, same era.
A time series is worth 64 words: Long-term forecasting with transformers
Nie, Y., Nguyen, N. H., Sinthong, P., and Kalagnanam, J · 2022
Cited alongside, same era.
Timesnet: Temporal 2d-variation modeling for general time series analysis
Wu, H., Hu, T., Liu, Y., Zhou, H., Wang, J., and Long, M · 2022
Cited alongside, same era.
Aim: Adapting image models for efficient video action recognition
Yang, T., Zhu, Y., Xie, Y., Zhang, A., Chen, C., and Li, M · 2022
Cited alongside, same era.
Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting
Zhang, Y. and Yan, J · 2022
Cited alongside, same era.
Later among the works it cites.
Large language models are zero-shot time series forecasters
Gruver, N., Finzi, M. A., Qiu, S., and Wilson, A. G · 2023
Later among the works it cites.
Time-llm: Time series forecasting by reprogramming large language models
Jin, M., Wang, S., Ma, L., Chu, Z., Zhang, J. Y., Shi, X., Chen, P.-Y., Liang, Y., Li, Y.-F., Pan, S., et al · 2023
Later among the works it cites.
itransformer: Inverted transformers are effective for time series forecasting
Liu, Y., Hu, T., Zhang, H., Wu, H., Wang, S., Ma, L., and Long, M · 2023
Later among the works it cites.
Lag-llama: Towards foundation models for time series forecasting
Rasul, K., Ashok, A., Williams, A. R., Khorasani, A., Adamopoulos, G., Bhagwatkar, R., Biloš, M., Ghonia, H., Hassen, N. V., Schneider, A., et al · 2023
Later among the works it cites.
Llama: Open and efficient foundation language models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al · 2023
Later among the works it cites.
Are transformers effective for time series forecasting?
Zeng, A., Chen, M., Zhang, L., and Xu, Q · 2023
Later among the works it cites.
One fits all: Power general time series analysis by pretrained lm
Zhou, T., Niu, P., Wang, X., Sun, L., and Jin, R · 2023
Later among the works it cites.