Approximations of conditional probability density functions in Lebesgue spaces via mixture of experts models

12/04/2020
by   Hien Duy Nguyen, et al.
1

Mixture of experts (MoE) models are widely applied for conditional probability density estimation problems. We demonstrate the richness of the class of MoE models by proving denseness results in Lebesgue spaces, when inputs and outputs variables are both compactly supported. We further prove an almost uniform convergence result when the input is univariate. Auxiliary lemmas are proved regarding the richness of the soft-max gating function class, and their relationships to the class of Gaussian gating functions.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset