Fluctuations of the diagonal entries of a large sample precision matrix
For a given p× n data matrix X_n with i.i.d. centered entries and a population covariance matrix Σ, the corresponding sample precision matrix Σ̂^-1 is defined as the inverse of the sample covariance matrix Σ̂ = (1/n) Σ^1/2X_nX_n^⊤Σ^1/2. We determine the joint distribution of a vector of diagonal entries of the matrix Σ̂^-1 in the situation, where p_n=p< n and p/n → y ∈ [0,1) for n→∞ and Σ is a diagonal matrix. Remarkably, our results cover both the case where the dimension is negligible in comparison to the sample size and the case where it is of the same magnitude. Our approach is based on a QR-decomposition of the data matrix, yielding a connection to random quadratic forms and allowing the application of a central limit theorem for martingale difference schemes. Moreover, we discuss an interesting connection to linear spectral statistics of the sample covariance matrix. More precisely, the logarithmic diagonal entry of the sample precision matrix can be interpreted as a difference of two highly dependent linear spectral statistics of Σ̂ and a submatrix of Σ̂. This difference of spectral statistics fluctuates on a much smaller scale than each single statistic.
READ FULL TEXT