2017

On the convergence of Hamiltonian Monte Carlo

Durmus, Alain, Moulines, Eric, Saksman, Eero

Understand

This paper discusses the irreducibility and geometric ergodicity of the Hamiltonian Monte Carlo (HMC) algorithm.

We consider cases where the number of steps of the symplectic integrator is either fixed or random.
Under mild conditions on the potential $\F$ associated with target distribution $\pi$, we first show that the Markov kernel associated to the HMC algorithm is irreducible and recurrent.
Under more stringent conditions, we then establish that the Markov kernel is Harris recurrent.

Hybrid monte carlo
S. Duane, A.D. Kennedy, B. J. Pendleton, and D. Roweth · 1987
Earlier work this paper cites.
Real and complex analysis
W. Rudin · 1987
Earlier work this paper cites.
Bayesian learning via stochastic dynamics
R. M. Neal · 1993
Earlier work this paper cites.
Markov chains for exploring posterior disiributions (with discussion)
Original
L. Tierney · 1994
Earlier work this paper cites.
Rates of convergence of the hastings and metropolis algorithms
K. L. Mengersen and R. L. Tweedie · 1996
Earlier work this paper cites.
Exponential convergence of Langevin distributions and their discrete approximations
G. O. Roberts and R. L. Tweedie · 1996
Earlier work this paper cites.
Geometric convergence and central limit theorems for multidimensional Hastings and Metropolis algorithms
G. O. Roberts and R. L. Tweedie · 1996
Earlier work this paper cites.
Geometric Numerical Integration: Structure-Preserving Algorithms for Ordinary Differential Equations
C. Lubich E. Hairer, G. Wanner · 2002
Earlier work this paper cites.
Multidimensional real analysis. I. Differentiation
J. J. Duistermaat and J. A. C. Kolk · 2004
Earlier work this paper cites.
Simulating Hamiltonian dynamics
B. Leimkuhler and S. Reich · 2004
Earlier work this paper cites.

Theoretical and numerical comparison of some sampling methods for molecular dynamics
E. Cancès, F. Legoll, and G. Stoltz · 2007
Cited alongside, same era.
Monte Carlo strategies in scientific computing
J. S. Liu · 2008
Cited alongside, same era.
Markov Chains and Stochastic Stability
S. Meyn and R. Tweedie · 2009
Cited alongside, same era.
Mapping degree theory
E. Outerelo and J. M. Ruiz · 2009
Cited alongside, same era.
Riemann manifold Langevin and Hamiltonian Monte Carlo methods
M. Girolami and B. Calderhead · 2011
Cited alongside, same era.
MCMC using Hamiltonian dynamics
R. M. Neal · 2011
Cited alongside, same era.
Geodesic Monte Carlo on Embedded Manifolds
S. Byrne and M. Girolami · 2013
Cited alongside, same era.
Analysis and geometry of Markov diffusion operators
D. Bakry, I. Gentil, and M. Ledoux · 2014
Cited alongside, same era.
Markov chain Monte Carlo and numerical differential equations
J. M. Sanz-Serna · 2014
Cited alongside, same era.

Learning generative models with visual attention
Y. Tang, N. Srivastava, and R. R. Salakhutdinov · 2014
Later among the works it cites.
Compressible generalized hybrid Monte Carlo (vol 140, 174108, 2014)
Y. Fang, J. M. Sanz-Serna, and R. D. Skeel · 2016
Later among the works it cites.
On the geometric ergodicity of Hamiltonian Monte Carlo
Original
S. Livingstone, M. Betancourt, S. Byrne, and M. Girolami · 2016
Later among the works it cites.
Relativistic monte carlo
Original
X. Lu, V. Perrone, L. Hasenclever, Y. W. Teh, and S. Vollmer · 2016
Later among the works it cites.
A model-based approach to climate reconstruction using tree-ring data
M. R. Schofield, R. J. Barker, A. Gelman, E. R. Cook, and K. R. Briffa · 2016
Later among the works it cites.
The geometric foundations of Hamiltonian Monte Carlo
M. Betancourt, S. Byrne, S. Livingstone, and M. Girolami · 2017
Closest in time.
Randomized Hamiltonian Monte Carlo
N. Bou-Rabee and J.M. Sanz-Serna · 2017
Closest in time.
Kinetic energy choice in hamiltonian/hybrid monte carlo
Original
S. Livingstone, M. F Faulkner, and G. O. Roberts · 2017
Closest in time.
Geometric integrators and the Hamiltonian Monte Carlo method
N. Bou-Rabee and J. M. Sanz-Serna · 2018
Closest in time.

alphaXiv searches the wider corpus for related work and actual follow-ups.

alphaXiv is searching for related work…

Reading the bibliography…