Fetching the paper…
Reading the bibliography…
Multivariate time series forecasting focuses on predicting future values based on historical context.
“Reducing Transformer Depth on Demand with Structured Dropout”, 2019
Angela Fan, Edouard Grave and Armand Joulin · 1909
Earlier work this paper cites.
“Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecasting”, 2020
Bryan Lim, Sercan. Arik, Nicolas Loeff and Tomas Pfister · 1912
Earlier work this paper cites.
“Long Short-Term Memory”
Sepp Hochreiter and Jürgen Schmidhuber · 1997
Earlier work this paper cites.
“Spatial-Temporal Transformer Networks for Traffic Flow Forecasting”, 2021
Mingxing Xu et al · 2001
Earlier work this paper cites.
“Meta-learning framework with applications to zero-shot time-series forecasting”, 2020
Boris. Oreshkin, Dmitri Carpov, Nicolas Chapados and Yoshua Bengio · 2002
Earlier work this paper cites.
“On Layer Normalization in the Transformer Architecture”, 2020
Ruibin Xiong et al · 2002
Earlier work this paper cites.
“PowerNorm: Rethinking Batch Normalization in Transformers”, 2020
Sheng Shen et al · 2003
Earlier work this paper cites.
“Understanding the Difficulty of Training Transformers”, 2020
Liyuan Liu et al · 2004
Earlier work this paper cites.
“Scheduled DropHead: A Regularization Method for Transformer Models”, 2020
Wangchunshu Zhou et al · 2004
Earlier work this paper cites.
“Language Models are Few-Shot Learners”
Tom. Brown et al · 2005
Earlier work this paper cites.
“Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks”, 2020
Zonghan Wu et al · 2005
Earlier work this paper cites.
“Linformer: Self-Attention with Linear Complexity”, 2020
Sinong Wang et al · 2006
Earlier work this paper cites.
“Rethinking Attention with Performers”, 2021
Krzysztof Choromanski et al · 2009
Earlier work this paper cites.
“Efficient Transformers: A Survey”
Yi Tay, Mostafa Dehghani, Dara Bahri and Donald Metzler · 2009
Earlier work this paper cites.
“Optimizing Transformer for Low-Resource Neural Machine Translation”, 2020
Ali Araabi and Christof Monz · 2011
Earlier work this paper cites.
“Long Range Arena: A Benchmark for Efficient Transformers”, 2020
Yi Tay et al · 2011
Earlier work this paper cites.
Alex Graves, Greg Wayne and Ivo Danihelka · 2014
Earlier work this paper cites.
“Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift”
Sergey Ioffe and Christian Szegedy · 2015
Earlier work this paper cites.
“Learning Convolutional Neural Networks for Graphs”, 2016
Mathias Niepert, Mohamed Ahmed and Konstantin Kutzkov · 2016
Earlier work this paper cites.
“Conditional time series forecasting with convolutional neural networks”
Anastasia Borovykh, Sander Bohte and Cornelis Oosterlee · 2017
Earlier work this paper cites.
“Attention is all you need”
Ashish Vaswani et al · 2017
Earlier work this paper cites.
“Long-Short Transformer: Efficient Transformers for Language and Vision”, 2021
Chen Zhu et al · 2017
Earlier work this paper cites.
“Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks”, 2018
Guokun Lai, Wei-Cheng Chang, Yiming Yang and Hanxiao Liu · 2018
Earlier work this paper cites.
“Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting”, 2018
Yaguang Li, Rose Yu, Cyrus Shahabi and Yan Liu · 2018
Earlier work this paper cites.
“Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting”
Bing Yu, Haoteng Yin and Zhanxing Zhu · 2018
Earlier work this paper cites.
“Generating long sequences with sparse transformers”
Rewon Child, Scott Gray, Alec Radford and Ilya Sutskever · 2019
Earlier work this paper cites.
“BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding”, 2019
Jacob Devlin, Ming-Wei Chang, Kenton Lee and Kristina Toutanova · 2019
Earlier work this paper cites.
“PyTorch Lightning”
et. Falcon WA · 2019
Earlier work this paper cites.
Qipeng Guo et al · 2019
Earlier work this paper cites.
“Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting”
Shengnan Guo et al · 2019
Earlier work this paper cites.
“Time2vec: Learning a vector representation of time”
Seyed Kazemi et al · 2019
Earlier work this paper cites.
“Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting”
Shiyang Li et al · 2019
Earlier work this paper cites.
“Contextualized non-local neural networks for sequence learning”
Pengfei Liu et al · 2019
Cited alongside, same era.
“The M4 Competition: 100,000 time series and 61 forecasting methods” M4 Competition
Spyros Makridakis, Evangelos Spiliotis and Vassilios Assimakopoulos · 2019
Cited alongside, same era.
“Transformers without tears: Improving the normalization of self-attention”
Toan Nguyen and Julian Salazar · 2019
Cited alongside, same era.
“PyTorch: An Imperative Style, High-Performance Deep Learning Library”
Adam Paszke et al · 2019
Cited alongside, same era.
“DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks”, 2019
David Salinas, Valentin Flunkert and Jan Gasthaus · 2019
Cited alongside, same era.
“Localvit: Bringing locality to vision transformers”
Yawei Li et al · 2021
Closest in time.
“Pyraformer: Low-complexity pyramidal attention for long-range time series modeling and forecasting”
Shizhan Liu et al · 2021
Closest in time.
“Swin Transformer: Hierarchical Vision Transformer using Shifted Windows”
Ze Liu et al · 2021
Closest in time.
“Yformer: U-Net Inspired Transformer Architecture for Far Horizon Time Series Forecasting”
Kiran Madhusudhanan et al · 2021
Closest in time.
“National Weather Service Automated Surface Observing System (ASOS)”, 2021
NOAA · 2021
Closest in time.
“DMGCRN: Dynamic Multi-Graph Convolution Recurrent Network for Traffic Forecasting”
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
“Temporal pattern attention for multivariate time series forecasting”
Shun-Yao Shih, Fan-Keng Sun and Hung-yi Lee · 2019
Cited alongside, same era.
“Graph wavenet for deep spatial-temporal graph modeling”
Zonghan Wu et al · 2019
Cited alongside, same era.
“Bp-transformer: Modelling long-range context via binary partitioning”
Zihao Ye et al · 2019
Cited alongside, same era.
“Adaptive graph convolutional recurrent network for traffic forecasting”
Lei Bai et al · 2020
Cited alongside, same era.
“Traffic transformer: Capturing the continuity and periodicity of time series for traffic forecasting”
Ling Cai et al · 2020
Cited alongside, same era.
“An image is worth 16x16 words: Transformers for image recognition at scale”
Alexey Dosovitskiy et al · 2020
Cited alongside, same era.
“Improving Transformer Optimization Through Better Initialization”
Xiao Huang, Felipe Perez, Jimmy Ba and Maksims Volkovs · 2020
Cited alongside, same era.
Yanjun Qin et al · 2021
Closest in time.
Benedek Rozemberczki et al · 2021
Closest in time.
“Spatial-temporal attention wavenet: A deep learning framework for traffic prediction considering spatial-temporal dependencies”
Chenyu Tian and Wai Chan · 2021
Closest in time.
“Pyramid vision transformer: A versatile backbone for dense prediction without convolutions”
Wenhai Wang et al · 2021
Closest in time.
“Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting”
Haixu Wu, Jiehui Xu, Jianmin Wang and Mingsheng Long · 2021
Closest in time.
“UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost”, 2021
Zhen Wu et al · 2021
Closest in time.
“TraverseNet: Unifying Space and Time in Message Passing”, 2021
Zonghan Wu et al · 2021
Closest in time.
“Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention”, 2021
Yunyang Xiong et al · 2021
Closest in time.
“Meta Graph Transformer: A Novel Framework for Spatial–Temporal Traffic Prediction”
Xue Ye et al · 2021
Closest in time.
“STNN: A Spatial-Temporal Graph Neural Network for Traffic Prediction”
Xueyan Yin et al · 2021
Closest in time.
“Poolingformer: Long Document Modeling with Pooling Attention”, 2021
Hang Zhang et al · 2021
Closest in time.
“Spatio-Temporal Joint Graph Convolutional Networks for Traffic Forecasting”, 2021
Chuanpan Zheng et al · 2021
Closest in time.
“Informer: Beyond efficient transformer for long sequence time-series forecasting”
Haoyi Zhou et al · 2021
Closest in time.
“Towards spatio-temporal aware traffic time series forecasting”
Razvan-Gabriel Cirstea et al · 2022
Closest in time.
“Preformer: Predictive Transformer with Multi-Scale Segment-wise Correlations for Long-Term Time Series Forecasting”
Dazhao Du, Bing Su and Zhewei Wei · 2022
Closest in time.
“General-purpose in-context learning by meta-learning transformers”
Louis Kirsch, James Harrison, Jascha Sohl-Dickstein and Luke Metz · 2022
Closest in time.
“DSTAGNN: Dynamic Spatial-Temporal Aware Graph Neural Network for Traffic Flow Forecasting”
Shiyong Lan et al · 2022
Closest in time.
“Spatial-Temporal Interactive Dynamic Graph Convolution Network for Traffic Forecasting”
Aoyu Liu and Yaying Zhang · 2022
Closest in time.
“cosFormer: Rethinking Softmax in Attention”
Zhen Qin et al · 2022
Closest in time.
“Einops: Clear and Reliable Tensor Manipulations with Einstein-like Notation”
Alex Rogozhnikov · 2022
Closest in time.
“TVGCN: Time-variant graph convolutional network for traffic forecasting”
Yuhu Wang et al · 2022
Closest in time.
“Spatial-Temporal Adaptive Graph Convolution with Attention Network for Traffic Forecasting”
Chen Weikang et al · 2022
Closest in time.
“ETSformer: Exponential Smoothing Transformers for Time-series Forecasting”
Gerald Woo et al · 2022
Closest in time.
“Are Transformers Effective for Time Series Forecasting?”
Ailing Zeng, Muxi Chen, Lei Zhang and Qiang Xu · 2022
Closest in time.
“FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting”
Tian Zhou et al · 2022
Closest in time.
“Evaluating time series forecasting models: An empirical study on performance estimation methods”
Vitor Cerqueira, Luis Torgo and Igor Mozetič · 2028
Closest in time.