CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuning

Language models are few-shot learners

Brown, T.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J. D.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; et al. 2020 · 1901

Earlier work this paper cites.

Supervised multimodal bitransformers for classifying images and text

Original

Kiela, D.; Bhooshan, S.; Firooz, H.; Perez, E.; and Testuggine, D. 2019 · 1909

Earlier work this paper cites.

Forecasting natural gas consumption in Istanbul using neural networks and multivariate time series methods

Demirel, Ö. F.; Zaim, S.; Çalişkan, A.; and Özuyar, P. 2012 · 2012

Earlier work this paper cites.

Efficient estimation of word representations in vector space

Original

Mikolov, T.; Chen, K.; Corrado, G.; and Dean, J. 2013 · 2013

Earlier work this paper cites.

Copula methods for forecasting multivariate time series

Patton, A. 2013 · 2013

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

Kingma, D. P.; and Ba, J. 2014 · 2014

Earlier work this paper cites.

An empirical evaluation of generic convolutional and recurrent networks for sequence modeling

Original

Bai, S.; Kolter, J. Z.; and Koltun, V. 2018 · 2018

Earlier work this paper cites.

The M4 Competition: Results, findings, conclusion and way forward

Makridakis, S.; Spiliotis, E.; and Assimakopoulos, V. 2018 · 2018

Earlier work this paper cites.

N-BEATS: Neural basis expansion analysis for interpretable time series forecasting

Oreshkin, B. N.; Carpov, D.; Chapados, N.; and Bengio, Y. 2019 · 2019

Earlier work this paper cites.

Language models are unsupervised multitask learners

Radford, A.; Wu, J.; Child, R.; Luan, D.; Amodei, D.; Sutskever, I.; et al. 2019 · 2019

Earlier work this paper cites.

Multivariate time series dataset for space weather data analytics

Angryk, R. A.; Martens, P. C.; Aydin, B.; Kempton, D.; Mahajan, S. S.; Basodi, S.; Ahmadzadeh, A.; Cai, X.; Filali Boubrahimi, S.; Hamdi, S. M.; et al. 2020 · 2020

Earlier work this paper cites.

A simple framework for contrastive learning of visual representations

Chen, T.; Kornblith, S.; Norouzi, M.; and Hinton, G. 2020 · 2020

Earlier work this paper cites.

LoRA: Low-rank adaptation of large language models

Original

Hu, E. J.; Shen, Y.; Wallis, P.; Allen-Zhu, Z.; Li, Y.; Wang, S.; Wang, L.; and Chen, W. 2021 · 2021

Earlier work this paper cites.

Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting

Wu, H.; Xu, J.; Wang, J.; and Long, M. 2021 · 2021

Cited alongside, same era.

Modeling protein using large-scale pretrain language model

Original

Xiao, Y.; Qiu, J.; Li, Z.; Hsieh, C.-Y.; and Tang, J. 2021 · 2021

Cited alongside, same era.

N-HiTS: Neural Hierarchical Interpolation for Time Series Forecasting

Original

Challu, C.; Olivares, K. G.; Oreshkin, B. N.; Garza, F.; Mergenthaler, M.; and Dubrawski, A. 2022 · 2022

Cited alongside, same era.

Large language models are zero-shot reasoners

Kojima, T.; Gu, S. S.; Reid, M.; Matsuo, Y.; and Iwasawa, Y. 2022 · 2022

Cited alongside, same era.

MICN: Multi-scale local and global context modeling for long-term series forecasting

Wang, H.; Peng, J.; Huang, F.; Wang, J.; Chen, J.; and Xiao, Y. 2022 · 2022

Cited alongside, same era.

Reprogramming pretrained language models for protein sequence representation learning

Original

Vinod, R.; Chen, P.-Y.; and Das, P. 2023 · 2023

Later among the works it cites.

TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis

Wu, H.; Hu, T.; Liu, Y.; Zhou, H.; Wang, J.; and Long, M. 2023 · 2023

Later among the works it cites.

Are transformers effective for time series forecasting?

Zeng, A.; Chen, M.; Zhang, L.; and Xu, Q. 2023 · 2023

Later among the works it cites.

Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting

Zhang, Y.; and Yan, J. 2023 · 2023

Later among the works it cites.

One Fits All: Power General Time Series Analysis by Pretrained LM

Zhou, T.; Niu, P.; Wang, X.; Sun, L.; and Jin, R. 2023 · 2023

Later among the works it cites.