Convergence of Contrastive Divergence Algorithm in Exponential Family
share
This paper studies the convergence properties of contrastive divergence algorithm for parameter inference in exponential family, by relating it to Markov chain theory and stochastic stability literature. We prove that, under mild conditions and given a finite data sample X_1,...,X_n ∼ p_θ^* i.i.d. in an event with probability approaching to 1, the sequence {θ_t}_t > 0 generated by CD algorithm is a positive Harris recurrent chain, and thus processes an unique invariant distribution π_n. The invariant distribution concentrates around the Maximum Likelihood Estimate at a speed arbitrarily slower than √(n), and the number of steps in Markov Chain Monte Carlo only affects the coefficient factor of the concentration rate. Finally we conclude that as n →∞, _t →∞1/t∑_s=1^t θ_s - θ^*p→ 0.
READ FULL TEXT