Fetching the paper…
Reading the bibliography…
Large pre-trained models excel in zero/few-shot learning for language and vision tasks but face challenges in multivariate time series (TS) forecasting due to diverse data characteristics.
Bike Sharing Dataset
Hadi Fanaee-T · 2013
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
BERT: pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Earlier work this paper cites.
Improving language understanding by generative pre-training
Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al · 2018
Earlier work this paper cites.
N-beats: Neural basis expansion analysis for interpretable time series forecasting
Boris N. Oreshkin, Dmitri Carpov, Nicolas Chapados, and Yoshua Bengio · 2020
Earlier work this paper cites.
Deepar: Probabilistic forecasting with autoregressive recurrent networks
David Salinas, Valentin Flunkert, Jan Gasthaus, and Tim Januschowski · 2020
Earlier work this paper cites.
It’s not just size that matters: Small language models are also few-shot learners
Timo Schick and Hinrich Schütze · 2020
Earlier work this paper cites.
Monash time series forecasting archive
Rakshitha Godahewa, Christoph Bergmeir, Geoffrey I. Webb, Rob J. Hyndman, and Pablo Montero-Manso · 2021
Earlier work this paper cites.
Forecasting: principles and practice
R.J. Hyndman and G. Athanasopoulos, editors · 2021
Earlier work this paper cites.
Prefix-tuning: Optimizing continuous prompts for generation
Xiang Lisa Li and Percy Liang · 2021
Earlier work this paper cites.
Swin transformer: Hierarchical vision transformer using shifted windows
Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo · 2021
Earlier work this paper cites.
M5 accuracy competition: Results, findings, and conclusions
Spyros Makridakis, Evangelos Spiliotis, and Vassilios Assimakopoulos · 2021
Earlier work this paper cites.
Mlp-mixer: An all-mlp architecture for vision
Ilya O Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Thomas Unterthiner, Jessica Yung, Andreas Steiner, Daniel Keysers, Jakob Uszkoreit, et al · 2021
Earlier work this paper cites.
Libcity: An open library for traffic prediction
Jingyuan Wang, Jiawei Jiang, Wenjun Jiang, Chao Li, and Wayne Xin Zhao · 2021
Earlier work this paper cites.
Autoformer: Decomposition transformers with Auto-Correlation for long-term series forecasting
Haixu Wu, Jiehui Xu, Jianmin Wang, and Mingsheng Long · 2021
Earlier work this paper cites.
A transformer-based framework for multivariate time series representation learning
George Zerveas, Srideepika Jayaraman, Dhaval Patel, Anuradha Bhamidipaty, and Carsten Eickhoff · 2021
Earlier work this paper cites.
Informer: Beyond efficient transformer for long sequence time-series forecasting
Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang · 2021
Cited alongside, same era.
Learning latent seasonal-trend representations for time series forecasting
Zhiyuan Wang, Xovee Xu, Weifeng Zhang, Goce Trajcevski, Ting Zhong, and Fan Zhou · 2022
Cited alongside, same era.
CoST: Contrastive learning of disentangled seasonal-trend representations for time series forecasting
Gerald Woo, Chenghao Liu, Doyen Sahoo, Akshat Kumar, and Steven Hoi · 2022
Cited alongside, same era.
Timesnet: Temporal 2d-variation modeling for general time series analysis
Haixu Wu, Tengge Hu, Yong Liu, Hang Zhou, Jianmin Wang, and Mingsheng Long · 2022
Cited alongside, same era.
Ts2vec: Towards universal representation of time series
Zhihan Yue, Yujing Wang, Juanyong Duan, Tianmeng Yang, Congrui Huang, Yunhai Tong, and Bixiong Xu · 2022
Cited alongside, same era.
Ti-mae: Self-supervised masked time series autoencoders
Zhe Li, Zhongwen Rao, Lujia Pan, Pengyun Wang, and Zenglin Xu · 2023
Later among the works it cites.
A time series is worth 64 words: Long-term forecasting with transformers
Yuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam · 2023
Later among the works it cites.
Lag-llama: Towards foundation models for time series forecasting
Kashif Rasul, Arjun Ashok, Andrew Robert Williams, Arian Khorasani, George Adamopoulos, Rishika Bhagwatkar, Marin Biloš, Hena Ghonia, Nadhir Vincent Hassen, Anderson Schneider, et al · 2023
Later among the works it cites.
https://github.com/BizITObs/BizITObservabilityData/tree/main/Complete/Time%20Series/RobotShop , 2023
BizITOps Dataset Repository · 2023
Later among the works it cites.
Tinygpt-v: Efficient multimodal large language model via small backbones
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Ailing Zeng, Muxi Chen, Lei Zhang, and Qiang Xu · 2022
Cited alongside, same era.
Self-supervised contrastive pre-training for time series via time-frequency consistency
Xiang Zhang, Ziyuan Zhao, Theodoros Tsiligkaridis, and Marinka Zitnik · 2022
Cited alongside, same era.
FEDformer: Frequency enhanced decomposed transformer for long-term series forecasting
Tian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang, Liang Sun, and Rong Jin · 2022
Cited alongside, same era.
A decoder-only foundation model for time-series forecasting
Abhimanyu Das, Weihao Kong, Rajat Sen, and Yichen Zhou · 2023
Cited alongside, same era.
Simmtm: A simple pre-training framework for masked time-series modeling
Jiaxiang Dong, Haixu Wu, Haoran Zhang, Li Zhang, Jianmin Wang, and Mingsheng Long · 2023
Cited alongside, same era.
Tsmixer: Lightweight mlp-mixer model for multivariate time series forecasting
Vijay Ekambaram, Arindam Jati, Nam Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam · 2023
Cited alongside, same era.
Timegpt-1, 2023
Azul Garza and Max Mergenthaler-Canseco · 2023
Cited alongside, same era.
Zhengqing Yuan, Zhaoxu Li, and Lichao Sun · 2023
Later among the works it cites.
One Fits All: Power general time series analysis by pretrained lm
Tian Zhou, Peisong Niu, Xue Wang, Liang Sun, and Rong Jin · 2023
Later among the works it cites.
Phi-3 technical report: A highly capable language model locally on your phone
Marah Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, et al · 2024
Closest in time.
Chronos: Learning the language of time series
Abdul Fatir Ansari, Lorenzo Stella, Caner Turkmen, Xiyuan Zhang, Pedro Mercado, Huibin Shen, Oleksandr Shchur, Syama Sundar Rangapuram, Sebastian Pineda Arango, Shubham Kapoor, et al · 2024
Closest in time.
Moment: A family of open time-series foundation models
Mononito Goswami, Konrad Szafer, Arjun Choudhry, Yifu Cai, Shuo Li, and Artur Dubrawski · 2024
Closest in time.
Time-LLM: Time series forecasting by reprogramming large language models
Ming Jin, Shiyu Wang, Lintao Ma, Zhixuan Chu, James Y. Zhang, Xiaoming Shi, Pin-Yu Chen, Yuxuan Liang, Yuan-Fang Li, Shirui Pan, and Qingsong Wen · 2024
Closest in time.
Unitime: A language-empowered unified model for cross-domain time series forecasting
Xu Liu, Junfeng Hu, Yuan Li, Shizhe Diao, Yuxuan Liang, Bryan Hooi, and Roger Zimmermann · 2024
Closest in time.
itransformer: Inverted transformers are effective for time series forecasting, 2024
Yong Liu, Tengge Hu, Haoran Zhang, Haixu Wu, Shiyu Wang, Lintao Ma, and Mingsheng Long · 2024
Closest in time.
Automixer for improved multivariate time-series forecasting on business and it observability data
Santosh Palaskar, Vijay Ekambaram, Arindam Jati, Neelamadhav Gantayat, Avirup Saha, Seema Nagar, Nam H Nguyen, Pankaj Dayama, Renuka Sindhgatta, Prateeti Mohapatra, et al · 2024
Closest in time.
Timemixer: Decomposable multiscale mixing for time series forecasting
Shiyu Wang, Haixu Wu, Xiaoming Shi, Tengge Hu, Huakun Luo, Lintao Ma, James Y Zhang, and JUN ZHOU · 2024
Closest in time.
Unified training of universal time series forecasting transformers
Gerald Woo, Chenghao Liu, Akshat Kumar, Caiming Xiong, Silvio Savarese, and Doyen Sahoo · 2024
Closest in time.