2020

MetNet: A Neural Weather Model for Precipitation Forecasting

Sønderby, Casper Kaae, Espeholt, Lasse, Heek, Jonathan et al.

Understand

Weather forecasting is a long standing scientific challenge with direct social and economic impact.

The task is suitable for deep neural networks due to vast amounts of continuously collected data and a rich spatial and temporal structure that presents long range dependencies.
We introduce MetNet, a neural network that forecasts precipitation up to 8 hours into the future at the high spatial resolution of 1 km$^2$ and at the temporal resolution of 2 minutes with a latency in the order of seconds.
MetNet takes as input radar and satellite data and forecast lead time and produces a probabilistic precipitation map.

Built on

An iterative image registration technique with an application to stereo vision
Bruce D Lucas, Takeo Kanade, et al · 1981
Earlier work this paper cites.
A Vision for the National Weather Service: Road Map for the Future
National Research Council · 1999
Earlier work this paper cites.
A three-dimensional variational data assimilation system for mm5: Implementation and initial results
Dale M Barker, Wei Huang, Yong-Run Guo, AJ Bourgeois, and QN Xiao · 2004
Earlier work this paper cites.
Development of a precipitation nowcasting algorithm based upon optical flow techniques
Neill EH Bowler, Clive E Pierce, and Alan Seed · 2004
Earlier work this paper cites.
Steps: A probabilistic precipitation forecasting scheme which merges an extrapolation nowcast with downscaled nwp
Neill E Bowler, Clive E Pierce, and Alan W Seed · 2006
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012
Earlier work this paper cites.
Formulation and evaluation of a scale decomposition-based stochastic precipitation nowcast scheme
Alan W Seed, Clive E Pierce, and Katie Norman · 2013
Earlier work this paper cites.
Everything you need to know numerical weathe prediction in about 100 minutes
Lou Wicker · 2013
Earlier work this paper cites.
TensorFlow: Large-scale machine learning on heterogeneous systems, 2015
Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Mané, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viégas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng · 2015
Earlier work this paper cites.
The quiet revolution of numerical weather prediction
Peter Bauer, Alan Thorpe, and Gilbert Brunet · 2015
Earlier work this paper cites.

Similar

Improved nowcasts by blending extrapolation and model forecasts
Yunsung Hwang, Adam J Clark, Valliappa Lakshmanan, and Steven E Koch · 2015
Cited alongside, same era.
Comparison of rainfall nowcasting derived from the steps model and jma precipitation nowcasts
Shakti P.C., Ryohei Misumi, Tsuyoshi Nakatani, Koyuru Iwanami, Masayuki Maki, Alan Seed, and Kohin Hirano · 2015
Cited alongside, same era.
U-net: Convolutional networks for biomedical image segmentation
Olaf Ronneberger, Philipp Fischer, and Thomas Brox · 2015
Cited alongside, same era.
Convolutional lstm network: A machine learning approach for precipitation nowcasting
Shi Xingjian, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-Kin Wong, and Wang-chun Woo · 2015
Cited alongside, same era.
A north american hourly assimilation and model forecast cycle: The rapid refresh
Stanley G Benjamin, Stephen S Weygandt, John M Brown, Ming Hu, Curtis R Alexander, Tatiana G Smirnova, Joseph B Olson, Eric P James, David C Dowell, Georg A Grell, et al · 2016
Cited alongside, same era.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Cited alongside, same era.
Fast optical flow using dense inverse search
Till Kroeger, Radu Timofte, Dengxin Dai, and Luc Van Gool · 2016
Cited alongside, same era.
Pixel recurrent neural networks
Original
Aaron van den Oord, Nal Kalchbrenner, and Koray Kavukcuoglu · 2016
Cited alongside, same era.
Multi-radar multi-sensor (mrms) quantitative precipitation estimation: Initial operating capabilities
Original
Jian Zhang, Kenneth Howard, Carrie Langston, Brian Kaney, Youcun Qi, Lin Tang, Heather Grams, Yadong Wang, Stephen Cocks, Steven Martinaitis, et al · 2016
Cited alongside, same era.
In-datacenter performance analysis of a tensor processing unit
Norman P Jouppi, Cliff Young, Nishant Patil, David Patterson, Gaurav Agrawal, Raminder Bajwa, Sarah Bates, Suresh Bhatia, Nan Boden, Al Borchers, et al · 2017
Cited alongside, same era.
Machine learning for precipitation nowcasting from radar images
Shreya Agrawal, Luke Barrington, Carla Bromberg, John Burge, Cenk Gazen, and Jason Hickey
Cited in the paper.
All convolutional neural networks for radar-based precipitation nowcasting
G Ayzel, M Heistermann, A Sorokin, O Nikitin, and O Lukyanova
Cited in the paper.

Then

Video pixel networks
Nal Kalchbrenner, Aäron van den Oord, Karen Simonyan, Ivo Danihelka, Oriol Vinyals, Alex Graves, and Koray Kavukcuoglu · 2017
Later among the works it cites.
Deep learning for precipitation nowcasting: A benchmark and a new model
Xingjian Shi, Zhihan Gao, Leonard Lausen, Hao Wang, Dit-Yan Yeung, Wai-kin Wong, and Wang-chun Woo · 2017
Later among the works it cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Later among the works it cites.
JAX: composable transformations of Python+NumPy programs, 2018
James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, and Skye Wanderman-Milne · 2018
Later among the works it cites.
Statement of guidance for global numerical weather prediction (nwp)
ECMWF · 2018
Later among the works it cites.
Large scale adversarial representation learning, 2019
Jeff Donahue and Karen Simonyan · 2019
Later among the works it cites.
Axial attention in multidimensional transformers, 2019
Jonathan Ho, Nal Kalchbrenner, Dirk Weissenborn, and Tim Salimans · 2019
Later among the works it cites.
Precipitation nowcasting with satellite imagery
Original
Vadim Lebedev, Vladimir Ivashkin, Irina Rudenko, Alexander Ganshin, Alexander Molchanov, Sergey Ovcharenko, Ruslan Grokhovetskiy, Ivan Bushmarinov, and Dmitry Solomentsev · 2019
Later among the works it cites.
Pysteps: an open-source python library for probabilistic precipitation nowcasting (v1. 0)
Seppo Pulkkinen, Daniele Nerini, Andrés A Pérez Hortal, Carlos Velasco-Forero, Alan Seed, Urs Germann, and Loris Foresti · 2019
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…