Implicit Copulas from Bayesian Regularized Regression Smoothers
We show how to extract the implicit copula of a response vector from a Bayesian regularized regression smoother with Gaussian disturbances. The copula can be used to compare smoothers that employ different shrinkage priors and function bases. We illustrate with three popular choices of shrinkage priors --- a pairwise prior, the horseshoe prior and a g prior augmented with a point mass as employed for Bayesian variable selection --- and both univariate and multivariate function bases. The implicit copulas are high-dimensional and unavailable in closed form. However, we show how to evaluate them by first constructing a Gaussian copula conditional on the regularization parameters, and then mixing over these using numerical or Monte Carlo methods. This greatly simplifies computation of the implicit copula compared to direct evaluation. The copulas are combined with non-parametric margins to extend the regularized smoothers to non-Gaussian data. Efficient Markov chain Monte Carlo schemes for evaluating the copula are given for this case. Using both simulated and real data, we show how such copula smoothing models can improve the quality of resulting function estimates and predictive distributions.
READ FULL TEXT