FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operators

P. Bauer, A. Thorpe, and G. Brunet, “The quiet revolution of numerical weather prediction,” Nature , vol. 525, no. 7567, pp. 47–55, 2015

2015

Earlier work this paper cites.

T. Schneider, J. Teixeira, C. S. Bretherton, F. Brient, K. G. Pressel, C. Schär, and A. P. Siebesma, “Climate goals and computing the future of clouds,” Nature Climate Change , vol. 7, pp. 3–5, 2017

2017

Earlier work this paper cites.

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” in Advances in neural information processing systems , 2017, pp. 5998–6008

2017

Earlier work this paper cites.

O. Fuhrer, T. Chadha, T. Hoefler, G. Kwasniewski, X. Lapillonne, D. Leutwyler, D. Lüthi, C. Osuna, C. Schär, T. C. Schulthess, and H. Vogt, “Near-global climate simulation at 1 km resolution: establishing a performance baseline on 4888 gpus with cosmo 5.0,” Geosci. Model Dev , vol. 11, pp. 1665–1681, 2018

2018

Earlier work this paper cites.

P. Neumann, P. Düben, P. Adamidis, P. Bauer, M. Brück, L. Kornblueh, D. Klocke, B. Stevens, N. Wedi, and J. Biercamp, “Assessing the scales in numerical weather and climate predictions: Will exascale be the rescue?” Philosophical Transactions of the Royal Society A , vol. 377, no. 2142, p. 20180148, 2019

2019

Earlier work this paper cites.

T. C. Schulthess, P. Bauer, N. Wedi, O. Fuhrer, T. Hoefler, and C. Schär, “Reflecting on the goal and baseline for exascale computing: A roadmap based on weather and climate simulations,” Comput. Sci. Eng. , vol. 21, pp. 30–41, 2019

2019

Earlier work this paper cites.

R. Child, S. Gray, A. Radford, and I. Sutskever, “Generating long sequences with sparse transformers,” arXiv preprint arXiv:1904.10509 , 2019

Original

2019

Earlier work this paper cites.

N. P. Wedi, I. Polichtchouk, P. Dueben, V. G. Anantharaj, P. Bauer, S. Boussetta, P. Browne, W. Deconinck, W. Gaudin, I. Hadade, S. Hatfield, O. Iffrig, P. Lopez, P. Maciel, A. Mueller1, S. Saarinen, I. Sandu, T. Quintino, and F. Vitart, “A baseline for global weather and climate simulations at 1 km resolution,” Journal of Advances in Modeling Earth Systems , vol. 12, p. e2020MS002192, 2020

2020

Earlier work this paper cites.

C. Schär, O. Fuhrer, A. Arteaga, N. Ban, C. Charpilloz, S. D. Girolamo, L. Hentgen, T. Hoefler, X. Lapillonne, D. Leutwyler, K. Osterried, D. Panosetti, S. Rüdisühli, L. Schlemmer, T. C. Schulthess, M. Sprenger, S. Ubbiali, and H. Wernli, “Kilometer-scale climate models: Prospects and challenges,” Bull. Amer. Meteor. Soc. , vol. 101, pp. E567–E587, 2020

2020

Earlier work this paper cites.

A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly et al. , “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929 , 2020

Original

2020

Earlier work this paper cites.

S. Wang, B. Z. Li, M. Khabsa, H. Fang, and H. Ma, “Linformer: Self-attention with linear complexity,” arXiv preprint arXiv:2006.04768 , 2020

Original

2020

Cited alongside, same era.

K. Choromanski, V. Likhosherstov, D. Dohan, X. Song, A. Gane, T. Sarlos, P. Hawkins, J. Davis, A. Mohiuddin, L. Kaiser et al. , “Rethinking attention with performers,” arXiv preprint arXiv:2009.14794 , 2020

Original

2020

Cited alongside, same era.

P. Bauer, T. Quintino, N. Wedi, A. Bonanni, M. Chrust, W. Deconinck, M. Diamantakis, P. Düben, S. English, J. Flemming et al. , The ECMWF scalability programme: Progress and plans . European Centre for Medium Range Weather Forecasts, 2020. [Online]. Available: https://www.ecmwf.int/node/19380

2020

Cited alongside, same era.

P. Bauer, B. Stevens, and W. Hazeleger, “A digital twin of Earth for the green transition,” Nature Climate Change , vol. 11, pp. 80–83, 2021

2021

Cited alongside, same era.

C. Riquelme, J. Puigcerver, B. Mustafa, M. Neumann, R. Jenatton, A. Susano Pinto, D. Keysers, and N. Houlsby, “Scaling vision with sparse mixture of experts,” Advances in Neural Information Processing Systems , vol. 34, 2021

2021

Later among the works it cites.

Z. Li, H. Zheng, N. Kovachki, D. Jin, H. Chen, B. Liu, K. Azizzadenesheli, and A. Anandkumar, “Physics-informed neural operator for learning partial differential equations,” arXiv preprint arXiv:2111.03794 , 2021

Original

2021

Later among the works it cites.

K. Kashinath, M. Mustafa, A. Albert, J. Wu, C. Jiang, S. Esmaeilzadeh, K. Azizzadenesheli, R. Wang, A. Chattopadhyay, A. Singh et al. , “Physics-informed machine learning: Case studies for weather and climate modelling,” Philosophical Transactions of the Royal Society A , vol. 379, no. 2194, p. 20200093, 2021

2021

Later among the works it cites.

J. Guibas, M. Mardani, Z. Li, A. Tao, A. Anandkumar, and B. Catanzaro, “Adaptive Fourier Neural Operators: Efficient token mixers for transformers,” International Conference on Representation Learning , April 2022