2018

DeepSphere: Efficient spherical Convolutional Neural Network with HEALPix sampling for cosmological applications

Perraudin, Nathanaël, Defferrard, Michaël, Kacprzak, Tomasz et al.

Understand

Convolutional Neural Networks (CNNs) are a cornerstone of the Deep Learning toolbox and have led to many breakthroughs in Artificial Intelligence.

These networks have mostly been developed for regular Euclidean domains such as those supporting images, audio, or video.
Because of their success, CNN-based methods are becoming increasingly popular in Cosmology.
Cosmological data often comes as spherical maps, which make the use of the traditional CNNs more complicated.

Built on

N. Krachmalnicoff, M. Tomasi, Convolutional neural networks on the healpix sphere: a pixel-based algorithm and its application to cmb data analysis, arXiv preprint arXiv:1902.04083
Original
1902
Earlier work this paper cites.
V. Rokhlin, M. Tygert, Fast algorithms for spherical harmonic expansions, SIAM Journal on Scientific Computing 27 (6) (2006) 1903–1928
1928
Earlier work this paper cites.
C. Ronchi, R. Iacono, P. S. Paolucci, The “cubed sphere”: a new method for the solution of partial differential equations in spherical geometry, Journal of Computational Physics 124 (1) (1996) 93–114
1996
Earlier work this paper cites.
Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition, Proceedings of the IEEE 86 (11) (1998) 2278–2324
1998
Earlier work this paper cites.
M. J. Mohlenkamp, A fast transform for spherical harmonics, Journal of Fourier analysis and applications 5 (2-3) (1999) 159–184
1999
Earlier work this paper cites.
arXiv:astro-ph/9912508
M. Bartelmann, P. Schneider, Weak gravitational lensing, Phys. Rep.340 (2001) 291–472 · 2001
Earlier work this paper cites.
K. M. Gorski, E. Hivon, A. Banday, B. D. Wandelt, F. K. Hansen, M. Reinecke, M. Bartelmann, Healpix: a framework for high-resolution discretization and fast analysis of data distributed on the sphere, The Astrophysical Journal 622 (2) (2005) 759
2005
Earlier work this paper cites.
M. Belkin, P. Niyogi, Convergence of laplacian eigenmaps, in: Advances in Neural Information Processing Systems, 2007, pp. 129–136
2007
Earlier work this paper cites.
K. T. Inoue, P. Cabella, E. Komatsu, Harmonic inpainting of the cosmic microwave background sky: Formulation and error estimate, Phys. Rev. D77 (12) (2008) 123539
2008
Earlier work this paper cites.
S. Amsel, J. Berger, R. H. Brandenberger, Detecting cosmic strings in the CMB with the Canny algorithm, J. Cosmology Astropart. Phys.4 (2008) 015
2008
Earlier work this paper cites.
M. Bartelmann, Gravitational lensing, Classical and Quantum Gravity 27 (23) (2010) 233001
2010
Earlier work this paper cites.
X. Glorot, Y. Bengio, Understanding the difficulty of training deep feedforward neural networks, in: Proceedings of the thirteenth international conference on artificial intelligence and statistics, 2010, pp. 249–256
2010
Earlier work this paper cites.
E. Komatsu, K. M. Smith, J. Dunkley, C. L. Bennett, B. Gold, G. Hinshaw, N. Jarosik, D. Larson, M. R. Nolta, L. Page, D. N. Spergel, M. Halpern, R. S. Hill, A. Kogut, M. Limon, S. S. Meyer, N. Odegard, G. S. Tucker, J. L. Weiland, E. Wollack, E. L. Wright, Seven-year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Interpretation, ApJS192 (2011) 18
2011
Earlier work this paper cites.
J. Xiao, K. A. Ehinger, A. Oliva, A. Torralba, Recognizing scene viewpoint using panoramic place representation, in: Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, IEEE, 2012, pp. 2695–2702
2012
Earlier work this paper cites.
S. Mallat, Group invariant scattering, Communications on Pure and Applied Mathematics 65 (10) (2012) 1331–1398
2012
Earlier work this paper cites.
D. I. Shuman, S. K. Narang, P. Frossard, A. Ortega, P. Vandergheynst, The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains, IEEE Signal Processing Magazine 30 (3) (2013) 83–98
2013
Earlier work this paper cites.
M. Reinecke, D. S. Seljebotn, Libsharp–spherical harmonic transforms revisited, Astronomy & Astrophysics 554 (2013) A112
2013
Earlier work this paper cites.
Y. Zhang, S. Song, P. Tan, J. Xiao, Panocontext: A whole-room 3d context model for panoramic scene understanding, in: European Conference on Computer Vision, Springer, 2014, pp. 668–686
2014
Earlier work this paper cites.

Similar

N. Kalchbrenner, E. Grefenstette, P. Blunsom, A convolutional neural network for modelling sentences, in: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vol. 1, 2014, pp. 655–665
2014
Cited alongside, same era.
M. Santos, P. Bull, D. Alonso, S. Camera, P. Ferreira, G. Bernardi, R. Maartens, M. Viel, F. Villaescusa-Navarro, F. B. Abdalla, M. Jarvis, R. B. Metcalf, A. Pourtsidou, L. Wolz, Cosmology from a SKA HI intensity mapping survey, Advancing Astrophysics with the Square Kilometre Array (AASKA14) (2015) 19
2015
Cited alongside, same era.
M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, S. Ghemawat, I. Goodfellow, A. Harp, G. Irving, M. Isard, Y. Jia, R. Jozefowicz, L. Kaiser, M. Kudlur, J. Levenberg, D. Mané, R. Monga, S. Moore, D. Murray, C. Olah, M. Schuster, J. Shlens, B. Steiner, I. Sutskever, K. Talwar, P. Tucker, V. Vanhoucke, V. Vasudevan, F. Viégas, O. Vinyals, P. Warden, M. Wattenberg, M. Wicke, Y. Yu, X. Zheng, TensorFlow: Large-scale machine learning on heterogeneous systems , software available from tensorflow.org (2015). URL https://www.tensorflow.org/
2015
Cited alongside, same era.
S. Ioffe, C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift, in: International Conference on Machine Learning, 2015, pp. 448–456
2015
Cited alongside, same era.
J. Long, E. Shelhamer, T. Darrell, Fully convolutional networks for semantic segmentation, in: Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 3431–3440
2015
Cited alongside, same era.
D. K. Duvenaud, D. Maclaurin, J. Iparraguirre, R. Bombarell, T. Hirzel, A. Aspuru-Guzik, R. P. Adams, Convolutional networks on graphs for learning molecular fingerprints, in: Advances in neural information processing systems, 2015, pp. 2224–2232
2015
Cited alongside, same era.
J. Masci, D. Boscaini, M. Bronstein, P. Vandergheynst, Geodesic convolutional neural networks on riemannian manifolds, in: Proceedings of the IEEE international conference on computer vision workshops, 2015, pp. 37–45
2015
Cited alongside, same era.
C. Howlett, M. Manera, W. J. Percival, L-PICOLA: A parallel code for fast dark matter simulation, Astronomy and Computing 12 (2015) 109–126
2015
Cited alongside, same era.
Planck Collaboration, Planck 2015 results. XIII. Cosmological parameters, A&A594 (2016) A13
2016
Cited alongside, same era.
HI4PI Collaboration, N. Ben Bekhti, L. Flöer, R. Keller, J. Kerp, D. Lenz, B. Winkel, J. Bailin, M. R. Calabretta, L. Dedes, H. A. Ford, B. K. Gibson, U. Haud, S. Janowiecki, P. M. W. Kalberla, F. J. Lockman, N. M. McClure-Griffiths, T. Murphy, H. Nakanishi, D. J. Pisano, L. Staveley-Smith, HI4PI: A full-sky H I survey based on EBHIS and GASS, A&A594 (2016) A116
2016
Cited alongside, same era.
S. Ravanbakhsh, J. Oliva, S. Fromenteau, L. C. Price, S. Ho, J. Schneider, B. Póczos, Estimating cosmological parameters from the dark matter distribution, in: Proceedings of the 33rd International Conference on International Conference on Machine Learning - Volume 48, ICML’16, JMLR.org, 2016, pp. 2407–2416
2016
Cited alongside, same era.
Planck Collaboration, Planck 2015 results. I. Overview of products and scientific results, A&A594 (2016) A1
2016
Cited alongside, same era.

Then

P. Frossard, R. Khasanova, Graph-based classification of omnidirectional images, in: 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), 2017, pp. 860–869
2017
Later among the works it cites.
N. Perraudin, P. Vandergheynst, Stationary signal processing on graphs., IEEE Trans. Signal Processing 65 (13) (2017) 3462–3477
2017
Later among the works it cites.
F. Monti, D. Boscaini, J. Masci, E. Rodola, J. Svoboda, M. M. Bronstein, Geometric deep learning on graphs and manifolds using mixture model cnns, in: Proc. CVPR, Vol. 1, 2017, p. 3
2017
Later among the works it cites.
M. M. Bronstein, J. Bruna, Y. LeCun, A. Szlam, P. Vandergheynst, Geometric deep learning: going beyond euclidean data, IEEE Signal Processing Magazine 34 (4) (2017) 18–42
2017
Later among the works it cites.
S. Parisot, S. I. Ktena, E. Ferrante, M. Lee, R. G. Moreno, B. Glocker, D. Rueckert, Spectral graph convolutions for population-based disease prediction, in: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer, 2017, pp. 177–185
2017
Later among the works it cites.
X. Qi, R. Liao, J. Jia, S. Fidler, R. Urtasun, 3d graph neural networks for rgbd semantic segmentation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 5199–5208
2017
Later among the works it cites.
F. Monti, M. Bronstein, X. Bresson, Geometric matrix completion with recurrent multi-graph neural networks, in: Advances in Neural Information Processing Systems, 2017, pp. 3697–3707
2017
Later among the works it cites.
K. Patton, J. Blazek, K. Honscheid, E. Huff, P. Melchior, A. J. Ross, E. Suchyta, Cosmological constraints from the convergence 1-point probability distribution, MNRAS472 (2017) 439–446
2017
Later among the works it cites.
S. Staggs, J. Dunkley, L. Page, Recent discoveries from the cosmic microwave background: a review of recent progress, Reports on Progress in Physics 81 (4) (2018) 044901
2018
Closest in time.
L. Lucie-Smith, H. V. Peiris, A. Pontzen, M. Lochner, Machine learning cosmological structure formation, MNRAS479 (2018) 3405–3414
2018
Closest in time.
A. Gupta, J. M. Z. Matilla, D. Hsu, Z. Haiman, Non-Gaussian information from weak lensing data via deep learning, Phys. Rev. D97 (10) (2018) 103515
2018
Closest in time.
S. Hassan, A. Liu, S. Kohn, J. E. Aguirre, P. La Plante, A. Lidz, Reionization Models Classifier using 21cm Map Deep Learning, in: V. Jelić, T. van der Hulst (Eds.), IAU Symposium, Vol. 333 of IAU Symposium, 2018, pp. 47–51
2018
Closest in time.
B. Abolfathi, D. S. Aguado, G. Aguilar, C. Allende Prieto, A. Almeida, T. T. Ananna, F. Anders, S. F. Anderson, B. H. Andrews, B. Anguiano, et al., The Fourteenth Data Release of the Sloan Digital Sky Survey: First Spectroscopic Data from the Extended Baryon Oscillation Spectroscopic Survey and from the Second Phase of the Apache Point Observatory Galactic Evolution Experiment, ApJS235 (2018) 42
2018
Closest in time.
B. Coors, A. P. Condurache, A. Geiger, Spherenet: Learning spherical representations for detection and classification in omnidirectional images, in: European Conference on Computer Vision, 2018
2018
Closest in time.
L. Le Magoarou, R. Gribonval, N. Tremblay, approximate fast graph fourier transforms via multi-layer sparse approximations, IEEE transactions on Signal and Information Processing over Networks 4 (2) (2018) 407–420
2018
Closest in time.
S. I. Ktena, S. Parisot, E. Ferrante, M. Rajchl, M. Lee, B. Glocker, D. Rueckert, Metric learning with spectral graph convolutions on brain connectivity networks, NeuroImage 169 (2018) 431–442
2018
Closest in time.
P. Baqué, E. Remelli, F. Fleuret, P. Fua, Geodesic convolutional shape optimization, in: International Conference on Machine Learning, 2018
2018
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…