Fetching the paper…

Reading the bibliography…

Recurrent machines for likelihood-free inference · Around

2018

Recurrent machines for likelihood-free inference

Pesah, Arthur, Wehenkel, Antoine, Louppe, Gilles

Original
PDF
Post on X

Understand

Likelihood-free inference is concerned with the estimation of the parameters of a non-differentiable stochastic simulator that best reproduce real observations.

In the absence of a likelihood function, most of the existing inference methods optimize the simulator parameters through a handcrafted iterative procedure that tries to make the simulated data more similar to the observations.
In this work, we explore whether meta-learning can be used in the likelihood-free context, for learning automatically from data an iterative optimization procedure that would solve likelihood-free inference problems.
We design a recurrent inference machine that learns a sequence of parameter updates leading to good parameter estimates, without ever specifying some explicit notion of divergence between the simulated data and the real data distributions.

Built on

Variational optimization
Original
Staines, J. and Barber, D. (2012) · 2012
Earlier work this paper cites.
Learning phrase representations using rnn encoder–decoder for statistical machine translation
Cho, K., van Merriënboer, B., Gülçehre, Ç., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014) · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
Original
Kingma, D. P. and Ba, J. (2014) · 2014
Earlier work this paper cites.
Natural evolution strategies
Wierstra, D., Schaul, T., Glasmachers, T., Sun, Y., Peters, J., and Schmidhuber, J. (2014) · 2014
Earlier work this paper cites.

Similar

Learning to learn by gradient descent by gradient descent
Andrychowicz, M., Denil, M., Gomez, S., Hoffman, M. W., Pfau, D., Schaul, T., and de Freitas, N. (2016) · 2016
Cited alongside, same era.
Learning to learn without gradient descent by gradient descent
Original
Chen, Y., Hoffman, M. W., Colmenarejo, S. G., Denil, M., Lillicrap, T. P., Botvinick, M., and de Freitas, N. (2016) · 2016
Cited alongside, same era.
Bayesian optimization for likelihood-free inference of simulator-based statistical models
Gutmann, M. U. and Corander, J. (2016) · 2016
Cited alongside, same era.
Adversarial variational optimization of non-differentiable simulators
Original
Louppe, G. and Cranmer, K. (2017) · 2017
Cited alongside, same era.

Then

Recurrent inference machines for solving inverse problems
Original
Putzky, P. and Welling, M. (2017) · 2017
Later among the works it cites.
Learning implicit generative models with the method of learned moments
Original
Ravuri, S., Mohamed, S., Rosca, M., and Vinyals, O. (2018) · 2018
Closest in time.
Approximate bayesian computation in population genetics
Beaumont, M. A., Zhang, W., and Balding, D. J. (2002) · 2035
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…