Fetching the paper…

Reading the bibliography…

2021

Nested Sampling with Normalising Flows for Gravitational-Wave Inference

Williams, Michael J., Veitch, John, Messenger, Chris

Original
PDF
Post on X

Understand

We present a novel method for sampling iso-likelihood contours in nested sampling using a type of machine learning algorithm known as normalising flows and incorporate it into our sampler nessai.

Nessai is designed for problems where computing the likelihood is computationally expensive and therefore the cost of training a normalising flow is offset by the overall reduction in the number of likelihood evaluations.
We validate our sampler on 128 simulated gravitational wave signals from compact binary coalescence and show that it produces unbiased estimates of the system parameters.
Subsequently, we compare our results to those obtained with dynesty and find good agreement between the computed log-evidences whilst requiring 2.07 times fewer likelihood evaluations.

Nested Sampling with Normalising Flows for Gravitational-Wave Inference · Around

Built on

M. Hoffman, P. Sountsov, J. V. Dillon, I. Langmore, D. Tran, and S. Vasudevan, NeuTra-lizing Bad Geometry in Hamiltonian Monte Carlo Using Neural Transport, arXiv e-prints , arXiv:1903.03704 (2019), arXiv:1903.03704 [stat.CO]
Original
1903
Earlier work this paper cites.
A. Moss, Accelerated Bayesian inference using deep learning, arXiv e-prints , arXiv:1903.10860 (2019), arXiv:1903.10860 [astro-ph.CO]
Original
1903
Earlier work this paper cites.
J. S. Speagle, DYNESTY: a dynamic nested sampling package for estimating Bayesian posteriors and evidences, MNRAS 493
Original
1904
Earlier work this paper cites.
C. Durkan, A. Bekasov, I. Murray, and G. Papamakarios, Neural Spline Flows, arXiv e-prints , arXiv:1906.04032 (2019a), arXiv:1906.04032 [stat.ML]
Original
1906
Earlier work this paper cites.
C. Durkan, A. Bekasov, I. Murray, and G. Papamakarios, Neural Spline Flows, arXiv e-prints , arXiv:1906.04032 (2019b), arXiv:1906.04032 [stat.ML]
Original
1906
Earlier work this paper cites.
B. Abbott et al. (LIGO Scientific, Virgo), A gravitational-wave measurement of the Hubble constant following the second observing run of Advanced LIGO and Virgo, arXiv e-prints (2019a), arXiv:1908.06060 [astro-ph.CO]
Original
1908
Earlier work this paper cites.
I. Kobyzev, S. J. D. Prince, and M. A. Brubaker, Normalizing Flows: An Introduction and Review of Current Methods, arXiv e-prints , arXiv:1908.09257 (2019), arXiv:1908.09257 [stat.ML]
Original
1908
Earlier work this paper cites.
H. Gabbard, C. Messenger, I. S. Heng, F. Tonolini, and R. Murray-Smith, Bayesian parameter estimation using conditional variational autoencoders for gravitational-wave astronomy, arXiv e-prints , arXiv:1909.06296 (2019), arXiv:1909.06296 [astro-ph.IM]
Original
1909
Earlier work this paper cites.
A. J. K. Chua and M. Vallisneri, Learning Bayesian Posteriors with Neural Networks for Gravitational-Wave Inference, Phys. Rev. Lett. 124
Original
1909
Earlier work this paper cites.
G. Papamakarios, E. Nalisnick, D. Jimenez Rezende, S. Mohamed, and B. Lakshminarayanan, Normalizing Flows for Probabilistic Modeling and Inference, arXiv e-prints , arXiv:1912.02762 (2019), arXiv:1912.02762 [stat.ML]
Original
1912
Earlier work this paper cites.
N. Smirnov, Table for estimating the goodness of fit of empirical distributions, The annals of mathematical statistics 19
1948
Earlier work this paper cites.
M. E. Muller, A note on a method for generating points uniformly on n-dimensional spheres, Commun. ACM 2
1959
Earlier work this paper cites.
G. Marsaglia, Choosing a point from the surface of a sphere, Ann. Math. Statist. 43
1972
Earlier work this paper cites.
S. R. Green, C. Simpson, and J. Gair, Gravitational-wave parameter estimation with autoregressive neural network flows, arXiv e-prints , arXiv:2002.07656 (2020), arXiv:2002.07656 [astro-ph.IM]
Original
2002
Earlier work this paper cites.
J. Brehmer and K. Cranmer, Flows for simultaneous manifold learning and density estimation, arXiv e-prints , arXiv:2003.13913 (2020), arXiv:2003.13913 [stat.ML]
Original
2003
Earlier work this paper cites.
T. Akutsu et al. (KAGRA), Overview of KAGRA: Detector design and construction history (2020), arXiv:2005.05574 [physics.ins-det]
Original
2005
Earlier work this paper cites.
E. Cuoco, J. Powell, M. Cavaglià, K. Ackley, M. Bejger, C. Chatterjee, M. Coughlin, S. Coughlin, P. Easter, R. Essick, H. Gabbard, T. Gebhard, S. Ghosh, L. Haegel, A. Iess, D. Keitel, Z. Marka, S. Marka, F. Morawski, T. Nguyen, R. Ormiston, M. Puerrer, M. Razzano, K. Staats, G. Vajente, and D. Williams, Enhancing Gravitational-Wave Science with Machine Learning, arXiv e-prints , arXiv:2005.03745 (2020), arXiv:2005.03745 [astro-ph.HE]
Original
2005
Earlier work this paper cites.
J. Skilling et al. , Nested sampling for general bayesian computation, Bayesian analysis 1
2006
Earlier work this paper cites.
I. M. Romero-Shaw, C. Talbot, S. Biscoveanu, V. D’Emilio, G. Ashton, C. P. L. Berry, S. Coughlin, S. Galaudage, C. Hoy, M. Huebner, K. S. Phukon, M. Pitkin, M. Rizzo, N. Sarin, R. Smith, S. Stevenson, A. Vajpeyi, M. Arene, K. Athar, S. Banagiri, N. Bose, M. Carney, K. Chatziioannou, R. Cotesta, B. Edelman, C. Garcia-Quiros, A. Ghosh, R. Green, C. J. Haster, A. X. Kim, F. Hernandez-Vivanco, I. Magana Hernandez, C. Karathanasis, P. D. Lasky, N. De Lillo, M. E. Lower, D. Macleod, M. Mateu-Lucena, A. Miller, M. Millhouse, S. Morisaki, S. H. Oh, S. Ossokine, E. Payne, J. Powell, M. Puerrer, A. Ramos-Buades, V. Raymond, E. Thrane, J. Veitch, D. Williams, M. J. Williams, and L. Xiao, Bayesian inference for compact binary coalescences with BILBY: Validation and application to the first LIGO–Virgo gravitational-wave transient catalogue, arXiv e-prints , arXiv:2006.00714 (2020), arXiv:2006.00714 [astro-ph.IM]
Original
2006
Earlier work this paper cites.
S. R. Cook, A. Gelman, and D. B. Rubin, Validation of software for bayesian models using posterior quantiles, Journal of Computational and Graphical Statistics 15
2006
Earlier work this paper cites.
A. Fowlie, W. Handley, and L. Su, Nested sampling cross-checks using order statistics, arXiv e-prints , arXiv:2006.03371 (2020), arXiv:2006.03371 [stat.CO]
Original
2006
Earlier work this paper cites.
J. D. Hunter, Matplotlib: A 2d graphics environment, Computing in Science & Engineering 9
2007
Earlier work this paper cites.
S. R. Green and J. Gair, Complete parameter inference for GW150914 using deep learning, arXiv e-prints , arXiv:2008.03312 (2020), arXiv:2008.03312 [astro-ph.IM]
Original
2008
Earlier work this paper cites.

Similar

F. Feroz, M. P. Hobson, and M. Bridges, MULTINEST: an efficient and robust Bayesian inference tool for cosmology and particle physics, MNRAS 398
Original
2009
Cited alongside, same era.
R. Abbott et al. (LIGO Scientific, Virgo), GWTC-2: Compact Binary Coalescences Observed by LIGO and Virgo During the First Half of the Third Observing Run (2020), arXiv:2010.14527 [gr-qc]
Original
2010
Cited alongside, same era.
J. Veitch and A. Vecchio, Bayesian coherent analysis of in-spiral gravitational wave signals with a detector network, Phys. Rev. D 81
Original
2010
Cited alongside, same era.
Wes McKinney, Data Structures for Statistical Computing in Python, in Proceedings of the 9th Python in Science Conference , edited by Stéfan van der Walt and Jarrod Millman (2010) pp. 56 – 61
2010
Cited alongside, same era.

Then

L. Dinh, J. Sohl-Dickstein, and S. Bengio, Density estimation using Real NVP, arXiv e-prints , arXiv:1605.08803 (2016), arXiv:1605.08803 [cs.LG]
Original
2016
Later among the works it cites.
K. He, X. Zhang, S. Ren, and J. Sun, Identity Mappings in Deep Residual Networks, arXiv e-prints , arXiv:1603.05027 (2016), arXiv:1603.05027 [cs.CV]
Original
2016
Later among the works it cites.
D. Foreman-Mackey, corner.py: Scatterplot matrices in python, The Journal of Open Source Software 1
2016
Later among the works it cites.
G. Papamakarios, T. Pavlakou, and I. Murray, Masked Autoregressive Flow for Density Estimation, arXiv e-prints , arXiv:1705.07057 (2017), arXiv:1705.07057 [stat.ML]
Original
2017
Later among the works it cites.
D. Levy, M. D. Hoffman, and J. Sohl-Dickstein, Generalizing Hamiltonian Monte Carlo with Neural Networks, arXiv e-prints , arXiv:1711.09268 (2017), arXiv:1711.09268 [stat.ML]

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

B. Iyer, T. Souradeep, C. Unnikrishnan, S. Dhurandhar, S. Raja, and A. Sengupta, LIGO-India, Proposal of the Consortium for Indian Initiative in Gravitational-wave Observations (IndIGO) , Tech. Rep. (LIGO Scientific Collaboration, 2011)

2011

Cited alongside, same era.

S. Brooks, A. Gelman, G. Jones, and X.-L. Meng, Handbook of markov chain monte carlo (CRC press, 2011)

2011

Cited alongside, same era.

T. B. Arnold and J. W. Emerson, Nonparametric goodness-of-fit tests for discrete null distributions., R Journal 3

2011

Cited alongside, same era.

S. van der Walt, S. C. Colbert, and G. Varoquaux, The numpy array: A structure for efficient numerical computation, Computing in Science Engineering 13

2011

Cited alongside, same era.

P. Schmidt, M. Hannam, and S. Husa, Towards models of gravitational waveforms from generic binaries: A simple approximate mapping between precessing and nonprecessing inspiral signals, Phys. Rev. D 86

2012

Cited alongside, same era.

J. Aasi et al. (LIGO Scientific, VIRGO), Parameter estimation for compact binary coalescence signals with the first generation gravitational-wave detector network, Phys. Rev. D 88

2013

Cited alongside, same era.

P. Graff and F. Feroz, BAMBI: Blind Accelerated Multimodal Bayesian Inference (2013), ascl:1312.008

2013

Cited alongside, same era.

B. Farr, E. Ochsner, W. M. Farr, and R. O’Shaughnessy, A more effective coordinate system for parameter estimation of precessing compact binaries from gravitational waves, Phys. Rev. D 90

2014

Cited alongside, same era.

2017

Later among the works it cites.

B. Abbott et al. (LIGO Scientific, Virgo), GW170817: Measurements of neutron star radii and equation of state, Phys. Rev. Lett. 121

2018

Later among the works it cites.

J. Lange, R. O’Shaughnessy, and M. Rizzo, Rapid and accurate parameter inference for coalescing, precessing compact binaries, arXiv e-prints , arXiv:1805.10457 (2018), arXiv:1805.10457 [gr-qc]

2018

Later among the works it cites.

C.-W. Huang, D. Krueger, A. Lacoste, and A. Courville, Neural Autoregressive Flows, arXiv e-prints , arXiv:1804.00779 (2018), arXiv:1804.00779 [cs.LG]

2018

Later among the works it cites.

D. P. Kingma and P. Dhariwal, Glow: Generative Flow with Invertible 1x1 Convolutions, arXiv e-prints , arXiv:1807.03039 (2018), arXiv:1807.03039 [stat.ML]

Original

2018

Later among the works it cites.

S. Talts, M. Betancourt, D. Simpson, A. Vehtari, and A. Gelman, Validating Bayesian Inference Algorithms with Simulation-Based Calibration, arXiv e-prints , arXiv:1804.06788 (2018), arXiv:1804.06788 [stat.ME]

2018

Later among the works it cites.

C. M. Biwer, C. D. Capano, S. De, M. Cabero, D. A. Brown, A. H. Nitz, and V. Raymond, PyCBC Inference: A Python-based Parameter Estimation Toolkit for Compact Binary Coalescence Signal, PASP 131

2019

Later among the works it cites.

G. Ashton, M. Hübner, P. D. Lasky, C. Talbot, K. Ackley, S. Biscoveanu, Q. Chu, A. Divakarla, P. J. Easter, B. Goncharov, F. Hernandez Vivanco, J. Harms, M. E. Lower, G. D. Meadors, D. Melchor, E. Payne, M. D. Pitkin, J. Powell, N. Sarin, R. J. E. Smith, and E. Thrane, BILBY: A User-friendly Bayesian Inference Library for Gravitational-wave Astronomy, ApJS 241

2019

Later among the works it cites.

A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga, A. Desmaison, A. Kopf, E. Yang, Z. DeVito, M. Raison, A. Tejani, S. Chilamkurthy, B. Steiner, L. Fang, J. Bai, and S. Chintala, Pytorch: An imperative style, high-performance deep learning library, in Advances in Neural Information Processing Systems 32 , edited by H. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alché Buc, E. Fox, and R. Garnett (Curran Associates, Inc., 2019) pp. 8024–8035

2019

Later among the works it cites.

S. Khan, K. Chatziioannou, M. Hannam, and F. Ohme, Phenomenological model for the gravitational-wave signal from precessing binary black holes with two-spin effects, Phys. Rev. D 100

2019

Later among the works it cites.

B. Abbott et al. (KAGRA, LIGO Scientific, VIRGO), Prospects for Observing and Localizing Gravitational-Wave Transients with Advanced LIGO, Advanced Virgo and KAGRA, Living Reviews in Relativity 23

2020

Later among the works it cites.

R. J. E. Smith, G. Ashton, A. Vajpeyi, and C. Talbot, Massively parallel Bayesian inference for transient gravitational-wave astronomy, Monthly Notices of the Royal Astronomical Society 498

2020

Later among the works it cites.

C. Durkan, A. Bekasov, I. Murray, and G. Papamakarios, nflows: normalizing flows in PyTorch (2020)

2020

Later among the works it cites.

P. Virtanen, R. Gommers, T. E. Oliphant, M. Haberland, T. Reddy, D. Cournapeau, E. Burovski, P. Peterson, W. Weckesser, J. Bright, S. J. van der Walt, M. Brett, J. Wilson, K. Jarrod Millman, N. Mayorov, A. R. J. Nelson, E. Jones, R. Kern, E. Larson, C. Carey, İ. Polat, Y. Feng, E. W. Moore, J. Vand erPlas, D. Laxalde, J. Perktold, R. Cimrman, I. Henriksen, E. A. Quintero, C. R. Harris, A. M. Archibald, A. H. Ribeiro, F. Pedregosa, P. van Mulbregt, and S. . . Contributors, SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python, Nature Methods 17

2020

Later among the works it cites.

T. pandas development team, pandas-dev/pandas: Pandas (2020)

2020

Later among the works it cites.

M. Waskom and the seaborn development team, mwaskom/seaborn (2020)

2020

Later among the works it cites.

J. Veitch, W. D. Pozzo, M. Williams, C. Talbot, M. Pitkin, G. Ashton, Cody, M. Hübner, A. Nitz, D. Macleod, G. Carullo, G. Davies, and Tony, johnveitch/cpnest: Version 0.11 (2021)

2021

Closest in time.

J. Buchner, Nested Sampling Methods (2021), arXiv:2101.09675 [stat.CO]

2021

Closest in time.