Exceedance as a measure of sparsity
Sparsity is defined as a limiting property of a sequence of probability distributions. It is characterized by a rate parameter and an exceedance measure, which may be finite or infinite. Many sparse integrals, including the signal-plus-noise convolution, are shown to depend on the signal distribution only through its rate parameter and exceedance measure. For statistical purposes, two sparse families having the same, or proportional, exceedance measures are equivalent to first order. Relative to the standard Gaussian distribution, the signal-plus-noise convolution is subject to tail inflation, the nature and extent of which is also determined by the exceedance measure and the sparsity rate. The relationship between the tail-inflation factor and the exceedance measure is given explicitly for the inverse-power measures by the convolution-mixture theorem, which expresses the signal-noise convolution as a specific two-component mixture.
READ FULL TEXT