Expectation Propagation for Approximate Inference: Free Probability Framework

01/16/2018
by   Burak Çakmak, et al.
0

We study asymptotic properties of expectation propagation (EP) - a method for approximate inference originally developed in the field of machine learning. Applied to generalized linear models, EP iteratively computes a multivariate Gaussian approximation to the exact posterior distribution. The computational complexity of the repeated update of covariance matrices severely limits the application of EP to large problem sizes. In this paper, we present a rigorous analysis by means of free probability theory that allows us to overcome this computational bottleneck if specific data matrices in the problem fulfill a certain property of asymptotic freeness. We demonstrate the relevance of our approach on the gene selection problem of a microarray dataset.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset