Nonparametric skew


In statistics and probability theory, the nonparametric skew is a statistic occasionally used with random variables that take real values. It is a measure of the skewness of a random variable's distribution—that is, the distribution's tendency to "lean" to one side or the other of the mean. Its calculation does not require any knowledge of the form of the underlying distribution—hence the name nonparametric. It has some desirable properties: it is zero for any symmetric distribution; it is unaffected by a scale shift; and it reveals either left- or right-skewness equally well. In some statistical samples it has been shown to be less powerful than the usual measures of skewness in detecting departures of the population from normality.

Properties

Definition

The nonparametric skew is defined as
where the mean, median and standard deviation of the population have their usual meanings.

Properties

The nonparametric skew is one third of the Pearson 2 skewness coefficient and lies between −1 and +1 for any distribution. This range is implied by the fact that the mean lies within one standard deviation of any median.
Under an affine transformation of the variable, the value of S does not change except for a possible change in sign. In symbols
where a ≠ 0 and b are constants and S is the nonparametric skew of the variable X.

Sharper bounds

The bounds of this statistic were sharpened by Majindar who showed that its absolute value is bounded by
with
and
where X is a random variable with finite variance, E is the expectation operator and Pr is the probability of the event occurring.
When p = q = 0.5 the absolute value of this statistic is bounded by 1. With p = 0.1 and p = 0.01, the statistic's absolute value is bounded by 0.6 and 0.199 respectively.

Extensions

It is also known that
where ν0 is any median and E is the expectation operator.
It has been shown that


where xq is the qth quantile. Quantiles lie between 0 and 1: the median has q = 0.5. This inequality has also been used to define a measure of skewness.
This latter inequality has been sharpened further.
Another extension for a distribution with a finite mean has been published:
The bounds in this last pair of inequalities are attained when and for fixed numbers a < b.

Finite samples

For a finite sample with sample size n ≥ 2 with xr is the rth order statistic, m the sample mean and s the sample standard deviation corrected for degrees of freedom,
Replacing r with n / 2 gives the result appropriate for the sample median:
where a is the sample median.

Statistical tests

Hotelling and Solomons considered the distribution of the test statistic
where n is the sample size, m is the sample mean, a is the sample median and s is the sample's standard deviation.
Statistical tests of D have assumed that the null hypothesis being tested is that the distribution is symmetric.
Gastwirth estimated the asymptotic variance of n−1/2D. If the distribution is unimodal and symmetric about 0, the asymptotic variance lies between 1/4 and 1. Assuming a conservative estimate can lead to a true level of significance well below the nominal level.
Assuming that the underlying distribution is symmetric Cabilio and Masaro have shown that the distribution of S is asymptotically normal. The asymptotic variance depends on the underlying distribution: for the normal distribution, the asymptotic variance of S is 0.5708...
Assuming that the underlying distribution is symmetric, by considering the distribution of values above and below the median Zheng and Gastwirth have argued that
where n is the sample size, is distributed as a t distribution.

Related statistics

Mira studied the distribution of the difference between the mean and the median.
where m is the sample mean and a is the median. If the underlying distribution is symmetrical γ1 itself is asymptotically normal. This statistic had been earlier suggested by Bonferroni.
Assuming a symmetric underlying distribution, a modification of S was studied by Miao, Gel and Gastwirth who modified the standard deviation to create their statistic.
where Xi are the sample values, || is the absolute value and the sum is taken over all n sample values.
The test statistic was
The scaled statistic T is asymptotically normal with a mean of zero for a symmetric distribution. Its asymptotic variance depends on the underlying distribution: the limiting values are, for the normal distribution = 0.5708... and, for the t distribution with three degrees of freedom, = 0.9689...

Values for individual distributions

Symmetric distributions

For symmetric probability distributions the value of the nonparametric skew is 0.

Asymmetric distributions

It is positive for right skewed distributions and negative for left skewed distributions. Absolute values ≥ 0.2 indicate marked skewness.
It may be difficult to determine S for some distributions. This is usually because a closed form for the median is not known: examples of such distributions include the gamma distribution, inverse-chi-squared distribution, the inverse-gamma distribution and the scaled inverse chi-squared distribution.
The following values for S are known:
In 1895 Pearson first suggested measuring skewness by standardizing the difference between the mean and the mode, giving
where μ, θ and σ is the mean, mode and standard deviation of the distribution respectively. Estimates of the population mode from the sample data may be difficult but the difference between the mean and the mode for many distributions is approximately three times the difference between the mean and the median which suggested to Pearson a second skewness coefficient:
where ν is the median of the distribution. Bowley dropped the factor 3 from this formula in 1901 leading to the nonparametric skew statistic.
The relationship between the median, the mean and the mode was first noted by Pearson when he was investigating his type III distributions.

Relationships between the mean, median and mode

For an arbitrary distribution the mode, median and mean may appear in any order.
Analyses have been made of some of the relationships between the mean, median, mode and standard deviation. and these relationships place some restrictions of the sign and magnitude of the nonparametric skew.
A simple example illustrating these relationships is the binomial distribution with n = 10 and p = 0.09. This distribution when plotted has a long right tail. The mean is to the left of the median but the skew as defined by the third standardized moment is positive. In contrast the nonparametric skew is -0.110.

Pearson's rule

The rule that for some distributions the difference between the mean and the mode is three times that between the mean and the median is due to Pearson who discovered it while investigating his Type 3 distributions. It is often applied to slightly asymmetric distributions that resemble a normal distribution but it is not always true.
In 1895 Pearson noted that for what is now known as the gamma distribution that the relation
where θ, ν and µ are the mode, median and mean of the distribution respectively was approximately true for distributions with a large shape parameter.
Doodson in 1917 proved that the median lies between the mode and the mean for moderately skewed distributions with finite fourth moments. This relationship holds for all the Pearson distributions and all of these distributions have a positive nonparametric skew.
Doodson also noted that for this family of distributions to a good approximation,
where θ, ν and µ are the mode, median and mean of the distribution respectively. Doodson's approximation was further investigated and confirmed by Haldane. Haldane noted that in samples with identical and independent variates with a third cumulant had sample means that obeyed Pearson's relationship for large sample sizes. Haldane required a number of conditions for this relationship to hold including the existence of an Edgeworth expansion and the uniqueness of both the median and the mode. Under these conditions he found that mode and the median converged to 1/2 and 1/6 of the third moment respectively. This result was confirmed by Hall under weaker conditions using characteristic functions.
Doodson's relationship was studied by Kendall and Stuart in the log-normal distribution for which they found an exact relationship close to it.
Hall also showed that for a distribution with regularly varying tails and exponent α that

Unimodal distributions

Gauss showed in 1823 that for a unimodal distribution
and
where ω is the root mean square deviation from the mode.
For a large class of unimodal distributions that are positively skewed the mode, median and mean fall in that order. Conversely for a large class of unimodal distributions that are negatively skewed the mean is less than the median which in turn is less than the mode. In symbols for these positively skewed unimodal distributions
and for these negatively skewed unimodal distributions
This class includes the important F, beta and gamma distributions.
This rule does not hold for the unimodal Weibull distribution.
For a unimodal distribution the following bounds are known and are sharp:
where μ,ν and θ are the mean, median and mode respectively.
The middle bound limits the nonparametric skew of a unimodal distribution to approximately ±0.775.

van Zwet condition

The following inequality,
where θ, ν and µ is the mode, median and mean of the distribution respectively, holds if
where F is the cumulative distribution function of the distribution. These conditions have since been generalised and extended to discrete distributions. Any distribution for which this holds has either a zero or a positive nonparametric skew.

Ordering of skewness

In 1964 van Zwet proposed a series of axioms for ordering measures of skewness. The nonparametric skew does not satisfy these axioms.

Benford's law

is an empirical law concerning the distribution of digits in a list of numbers. It has been suggested that random variates from distributions with a positive nonparametric skew will obey this law.

Relation to Bowley's coefficient

This statistic can be derived from Bowley's coefficient of skewness
where Qi is the ith quartile of the distribution.
Hinkley generalised this
where lies between 0 and 0.5. Bowley's coefficient is a special case with equal to 0.25.
Groeneveld and Meeden removed the dependence on by integrating over it.
The denominator is a measure of dispersion. Replacing the denominator with the standard deviation we obtain the nonparametric skew.