On free energy barriers in Gaussian priors and failure of MCMC for high-dimensional unimodal distributions

09/05/2022
by   Afonso S. Bandeira, et al.
6

We exhibit examples of high-dimensional unimodal posterior distributions arising in non-linear regression models with Gaussian process priors for which worst-case (`cold start') initialised MCMC methods typically take an exponential run-time to enter the regions where the bulk of the posterior measure concentrates. The counter-examples hold for general MCMC schemes based on gradient or random walk steps, and the theory is illustrated for Metropolis-Hastings adjusted methods such as pCN and MALA.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset